Advances in Neural Information Processing Systems, 34:27826–27839, 2021. 38

A. Baevski, A. Babu, W.-N. Hsu, and M. Auli. Eﬃcient self-supervised learning with
contextualized target representations for vision, speech and language. arXiv preprint
arXiv:2212.07525, 2022. 21, 36

D. Bahri, H. Jiang, Y. Tay, and D. Metzler. Scarf: Self-supervised contrastive learning

using random feature corruption. arXiv preprint arXiv:2106.15147, 2021. 39

R. Balestriero and Y. LeCun. Contrastive and non-contrastive self-supervised learning
recover global and local spectral embedding methods. arXiv preprint arXiv:2205.11508,
2022. 4

H. Bao, L. Dong, S. Piao, and F. Wei. Beit: Bert pre-training of image transformers. arXiv

preprint arXiv:2106.08254, 2021a. 15, 16

H. Bao, L. Dong, and F. Wei. BEiT: BERT pre-training of image transformers. 2021b. 29,

30, 31, 32
A Cookbook of Self-Supervised Learning