H. Touvron, M. Cord, A. Sablayrolles, G. Synnaeve, and H. Jégou. Going deeper with image
transformers. In Proceedings of the IEEE/CVF International Conference on Computer
Vision, pages 32–42, 2021b. 28, 29

H. Touvron, M. Cord, and H. Jégou. Deit iii: Revenge of the vit. In Computer Vision–ECCV
2022: 17th European Conference, Tel Aviv, Israel, October 23–27, 2022, Proceedings, Part
XXIV, pages 516–533. Springer, 2022. 28

M. Tschannen, J. Djolonga, P. K. Rubenstein, S. Gelly, and M. Lucic. On mutual information

maximization for representation learning, 2020. 17

T. Ucar, E. Hajiramezanali, and L. Edwards. Subtab: Subsetting features of tabular data
for self-supervised representation learning. Advances in Neural Information Processing
Systems, 34:18853–18865, 2021. 39

A. Vaswani, N. Shazeer, N. Parmar, J. Uszkoreit, L. Jones, A. N. Gomez, Ł. Kaiser, and
I. Polosukhin. Attention is all you need. Advances in neural information processing
systems, 30, 2017. 36
A Cookbook of Self-Supervised Learning