Xinlei Chen and Kaiming He. Exploring simple siamese representation learning. preprint arXiv:2011.10566,

2020.

Xinlei Chen, Saining Xie, and Kaiming He. An empirical study of training self-supervised vision transformers.

arXiv preprint arXiv:2104.02057, 2021.

Zhe Chen, Yuchen Duan, Wenhai Wang, Junjun He, Tong Lu, Jifeng Dai, and Yu Qiao. Vision transformer

adapter for dense predictions. arXiv preprint arXiv:2205.08534, 2022.

Bowen Cheng, Ishan Misra, Alexander G Schwing, Alexander Kirillov, and Rohit Girdhar. Masked-attention
In Proceedings of the IEEE/CVF Conference on

mask transformer for universal image segmentation.
Computer Vision and Pattern Recognition, pp. 1290–1299, 2022.

21

Aakanksha Chowdhery, Sharan Narang, Jacob Devlin, Maarten Bosma, Gaurav Mishra, Adam Roberts,
Paul Barham, Hyung Won Chung, Charles Sutton, Sebastian Gehrmann, et al. Palm: Scaling language
modeling with pathways. arXiv preprint arXiv:2204.02311, 2022.
DINOv2- Learning Robust Visual Features without Supervision