Deep Learning, Artificial Intelligence, Image Classification, Vision Transformer, Resnet.
Letting K=X X^T and L=Y Y^T denote the Gram matrices for the two layers (which measures the similarity of a pair of datapoints according to layer representations), CKA computes: where HSIC is the Hilbert-Schmidt independence criterion [15]. Given the centering matrix H and the centered Gram