Invariance

0° Rotation
Rotating a patch does not change its morphology, so rotated views should map to nearly the same embedding.
Invariance × Expressiveness
Expressiveness keeps the model from collapsing everything together: different tissues stay apart.
Theoretical trade-off
Expressiveness
Invariance
INVEX
Representation collapse
Rotation sensitive
Ideal (INVEX)
Empirical rankings
Expressiveness
Invariance
Encoder 1
(Rank 3)
Encoder 2
(Rank 2)
Encoder 3
(Rank 1)