Paper Review, Deep Learning, Self Supervised Learning, Computer Vision, Pretrained Model.
classification tasks compared to a smaller ViT-H/14 model. However, the performance on low-level downstream tasks did not see a similar improvement as larger input patches used by ViT-G/16 could be detrimental for local prediction tasks. Predictor Visualizations The role of the predictor in I-JEPA