Paper Review, Deep Learning, Self Supervised Learning, Computer Vision, Pretrained Model.
is computed entirely in representation space, giving the target encoder the ability to produce abstract prediction targets, while eliminating irrelevant pixel-level details. Predicting in pixel-space led to a significant degradation in the linear probing performance. In addition, they compared