Winograd Schema Challenge at Scale. Communications of the ACM, 2021.

Teven Le Scao, Thomas Wang, Daniel Hesslow, Lucile Saulnier, Stas Bekman, M Saiful Bari, Stella Biderman,
Hady Elsahar, Niklas Muennighoﬀ, Jason Phang, et al. What Language Model to Train if You Have One
Million GPU Hours?, 2022. URL https://arxiv.org/abs/2210.15424.

Teven Le Scao, Angela Fan, Christopher Akiki, Ellie Pavlick, Suzana Ilić, Daniel Hesslow, Roman Castagné,
Alexandra Sasha Luccioni, François Yvon, Matthias Gallé, et al. BLOOM: A 176B-Parameter Open-Access
Multilingual Language Model, 2023. URL https://arxiv.org/abs/2211.05100.

Samuel S. Schoenholz, Justin Gilmer, Surya Ganguli, and Jascha Sohl-Dickstein. Deep Information Propa-

gation. In International Conference on Learning Representations, 2017.
Cerebras-GPT- Open Compute-Optimal Language Models Trained on the Cerebras Wafer-Scale Cluster