6. Multi-view invariance: Many modern SSL methods, especially those that we focus
on in this article, use contrastive learning to create feature representations that are
invariant to simple transforms. The idea of contrastive learning is to encourage a model
to represent two augmented versions of an input similarly. A number of methods led the
charge in this direction by enforcing invariance in various ways before contrastive learning
was widely adopted.
A Cookbook of Self-Supervised Learning