Deep Learning, Artificial Intelligence, Image Classification, Self Supervised Learning, NLP.
image embedding. Speech data is encoded using a multi-layer 1-D convolutional neural network that maps 16 kHz waveform to 50 Hz representations (wav2vec 2.0). Text is pre-processed to obtain sub-word units (Byte Pair Encoding (BPE), BERT) first. RoBERTa is used. 1.2. Masking Part of tokens is