Paper Review, Deep Learning, Self Supervised Learning, Computer Vision, Pretrained Model.
the context encoder, target encoder, and predictor. These encoders and predictors are similar to the generative masked autoencoders (MAE), but I-JEPA differs by being non-generative, predicting in the representation space. In I-JEPA, the targets are the representations of image blocks. The image is