Hernandez, F., Nguyen, V., Ghannay, S., Tomashenko, N. A.,
and Est`eve, Y. Ted-lium 3: twice as much data and corpus
repartition for experiments on speaker adaptation.
In
SPECOM, 2018.

Hsu, W.-N., Bolte, B., Tsai, Y.-H. H., Lakhotia, K.,
Salakhutdinov, R., and Mohamed, A. Hubert: Self-
supervised speech representation learning by masked
prediction of hidden units. IEEE/ACM Transactions on
Audio, Speech, and Language Processing, 29:3451–3460,
2021a.

Hsu, W.-N., Sriram, A., Baevski, A., Likhomanenko, T.,
Xu, Q., Pratap, V., Kahn, J., Lee, A., Collobert, R., Syn-
naeve, G., et al. Robust wav2vec 2.0: Analyzing do-
main shift in self-supervised pre-training. arXiv preprint
arXiv:2104.01027, 2021b.

Huang, G., Sun, Y., Liu, Z., Sedra, D., and Weinberger,
K. Q. Deep networks with stochastic depth. In European
conference on computer vision, pp. 646–661. Springer,
2016.
RobustSpeechRecognitionviaLarge-ScaleWeakSupervision