Paper Review, Deep Learning, Self Supervised Learning, Computer Vision, Pretrained Model.
shows significant improvements over previous methods like MAE and data2vec that don’t use augmentations. I-JEPA decreases the gap with view-invariance-based methods that do use hand-crafted data augmentations during pretraining, and even surpasses the popular DINO method on CIFAR100 and Place205