Deep Learning, Artificial Intelligence, Image Classification, Self Supervised Learning, NLP.
ViT-B and ViT-L in the single model setting and all prior work for ViT-L. 2.2. Speech Speech data2vec is pre-trained on the 960 hours of speech audio data from Librispeech (LS-960). The above table shows improvements for most labeled data setups with the largest gains for 10 minutes of labeled data