Deep Learning, Artificial Intelligence, Image Classification, Self Supervised Learning, NLP.
computer vision. The core idea is to predict latent representations of the full input data based on a masked view of the input in a self-distillation setup using a standard Transformer architecture. data2vec predicts contextualized latent representations instead of predicting modality-specific