when training a ResNet than increasing the width or depth of the ResNet as illustrated
in Figure 12b. This observation highlights that the current architectures used in SSL,
which are often the same as the those used in supervised training, might not be optimal.
A Cookbook of Self-Supervised Learning