Weakly-curated training data : A successful approach to leverage large uncurated
datasets is to perform retrieval in them based on curated data. This means that the
dataset will contain images similar to a curated or smaller source dataset such as ImageNet,
while being much larger and more diverse. This strategy was used in DINOv2 [Oquab
et al., 2023] where LVD-142M was built using a wide variety of small and domain speciﬁc
datasets. While this does not lead to big performance boosts in classiﬁcation on ImageNet,
it can lead to signiﬁcant boosts in performance on other tasks such as image retrieval.

3 A Cook’s Guide to Successful SSL Training and Deploy-

ment
A Cookbook of Self-Supervised Learning