Deep Learning, Computer Vision, Cnn, Transformers, AI.
Investigating the (hidden) layer representations in CNNs and ViTs is difficult due to the diverse nature of the properties spread across a large number of neurons. The Center Kernel Alignment (CKA) method, which has been used enables a meaningful comparison of representations across these networks