Ben Hutchinson, Vinodkumar Prabhakaran, Emily
Denton, Kellie Webster, Yu Zhong, and Stephen De-
Social biases in NLP models as bar-
nuyl. 2020.
arXiv preprint
riers for persons with disabilities.
arXiv:2005.00813.

Eun Seo Jo and Timnit Gebru. 2020. Lessons from
archives: Strategies for collecting sociocultural data in
In Proceedings of the 2020 Con-
machine learning.
ference on Fairness, Accountability, and Transparency,
pages 306–316.

Jared Kaplan, Sam McCandlish, Tom Henighan,
Tom B Brown, Benjamin Chess, Rewon Child, Scott
Gray, Alec Radford, Jeffrey Wu, and Dario Amodei.
2020. Scaling laws for neural language models. arXiv
preprint arXiv:2001.08361.

Bryan Klimt and Yiming Yang. 2004. The Enron cor-
pus: A new dataset for email classiﬁcation research.
In European Conference on Machine Learning, pages
217–226. Springer.

Sosuke Kobayashi. 2018.
pus.
cifar-10-cnn.

Homemade bookcor-
https://github.com/BIGBALLON/
The Pile- An 800GB Dataset of Diverse Text for Language Modeling