Paper Review, Deep Learning, Self Supervised Learning, Computer Vision, Pretrained Model.
average L2 distance between the predicted patch-level representations and the target patch-level representation. The parameters of the predictor and context encoder are learned through gradient-based optimization, while the parameters of the target encoder are updated via an exponential moving