Paper Review, Deep Learning, Self Supervised Learning, Computer Vision, Pretrained Model.
Autoencoders (MAE), Context Autoencoders (CAE), and data2vec, particularly regarding computational effort. With the improved efficiency of I-JEPA, larger models could be trained that outperformed the best CAE models using less computation. I-JEPA’s performance even matches view-invariant approaches