Paper Review, Deep Learning, Self Supervised Learning, Computer Vision, Pretrained Model.
is to use the output of the context encoder and, when conditioned on positional mask tokens, predict the representations of a target block at the location indicated by the mask tokens. The researchers wanted to investigate whether this predictor, when conditioned on positional mask tokens, is