Deep Learning, Computer Vision, Cnn, Transformers, AI.
representations in ResNet using CKA similarity, it becomes clear that lower ResNet layers are most similar to the features learned by ViT’s local attention heads. As more global information is incorporated, the similarity decreases monotonically, indicating that global heads learn qualitatively