Yu Zhang, Daniel S. Park, Wei Han, James Qin, Anmol Gulati, Joel Shor, Aren Jansen, Yuanzhong
Xu, Yanping Huang, Shibo Wang, Zongwei Zhou, Bo Li, Min Ma, William Chan, Jiahui Yu,

19

Yongqiang Wang, Liangliang Cao, Khe Chai Sim, Bhuvana Ramabhadran, Tara N. Sainath,
Franc¸oise Beaufays, Zhifeng Chen, Quoc V. Le, Chung-Cheng Chiu, Ruoming Pang, and Yonghui
Wu. BigSSL: Exploring the Frontier of Large-Scale Semi-Supervised Learning for Automatic
Speech Recognition. IEEE Journal of Selected Topics in Signal Processing, 16(6):1519–1532,
2022. doi: 10.1109/JSTSP.2022.3182537.
DISTIL-WHISPER