Paper Review, Deep Learning, Self Supervised Learning, Computer Vision, Pretrained Model.
problem of representation collapse, which can be mitigated by an asymmetric architecture between the encoders. Method The overall objective of I-JEPA is to predict the representations of various target blocks in an image using a single context block. The model employs a Vision Transformer (ViT) for