Paper Review, Deep Learning, Self Supervised Learning, Computer Vision, Pretrained Model.
corresponding patch-level representation. To predict the target block representations, the predictor takes the output of the context encoder and a mask token for each patch it wishes to predict and outputs a patch-level prediction. This is done for each target block. The loss is calculated as the