Alexander Halavais. 2019. Overcoming terms of ser-
vice: a proposal for ethical distributed research. Infor-
mation, Communication & Society, 22(11):1567–1581.

Chris Hardin. 2018. How to shufﬂe a big dataset.

Tom Henighan, Jared Kaplan, Mor Katz, Mark Chen,
Christopher Hesse, Jacob Jackson, Heewoo Jun, Tom B
Brown, Prafulla Dhariwal, Scott Gray, et al. 2020. Scal-
ing laws for autoregressive generative modeling. arXiv
preprint arXiv:2010.14701.

Matthew Hoffman, Francis Bach, and David Blei.
2010. Online learning for latent dirichlet allocation.
advances in neural information processing systems,
23:856–864.

Dirk Hovy and Shannon L Spruit. 2016. The social im-
pact of natural language processing. In Proceedings of
the 54th Annual Meeting of the Association for Com-
putational Linguistics (Volume 2: Short Papers), pages
591–598.
The Pile- An 800GB Dataset of Diverse Text for Language Modeling