Christian Sarofeen, Piotr Bialecki, Jie Jiang, Kevin Stephano, Masaki Kozuki, Neal Vaidya, and
Stas Bekman. Introducing nvFuser, a deep learning compiler for PyTorch, August 2022. URL
https://pytorch.org/blog/introducing-nvfuser-a-deep-learning-com
piler-for-pytorch/.

Teven Le Scao, Thomas Wang, Daniel Hesslow, Lucile Saulnier, Stas Bekman, M. Saiful Bari,
Stella Biderman, Hady Elsahar, Jason Phang, Oﬁr Press, Colin Raffel, Victor Sanh, Sheng Shen,
Lintang Sutawika, Jaesung Tae, Zheng Xin Yong, Julien Launay, and Iz Beltagy. What Language
Model to Train if You Have One Million GPU Hours? In Challenges {\&, April 2022. URL
https://openreview.net/forum?id=rI7BL3fHIZq.

Avi Schwarzschild. Easy-To-Hard, October 2021. URL https://github.com/aks2203/e

asy-to-hard.
CRAMMING-TRAININGALANGUAGEMODELONA SINGLEGPUINONEDAY