Z. Li, Y. Tang, W. Li, and Y. He. Learning disentangled representation with pairwise
independence. In Proceedings of the AAAI conference on artiﬁcial intelligence, 2019. 25
Z. Li, Z. Chen, F. Yang, W. Li, Y. Zhu, C. Zhao, R. Deng, L. Wu, R. Zhao, M. Tang, et al.
Mst: Masked self-supervised transformer for visual representation. Advances in Neural
Information Processing Systems, 34:13165–13176, 2021b. 43

S. Liu, A. Mallol-Ragolta, E. Parada-Cabeleiro, K. Qian, X. Jing, A. Kathan, B. Hu, and B. W.
Schuller. Audio self-supervised learning: A survey. arXiv preprint arXiv:2203.01205,
2022a. 3, 38

57

X. Liu, J. Zhou, T. Kong, X. Lin, and R. Ji. Exploring target representations for masked

autoencoders. arXiv preprint arXiv:2209.03917, 2022b. 29

I. Loshchilov and F. Hutter. Decoupled weight decay regularization. arXiv preprint

arXiv:1711.05101, 2017. 27
A Cookbook of Self-Supervised Learning