Jessica Vitak, Katie Shilton, and Zahra Ashktorab.
2016. Beyond the Belmont principles: Ethical chal-
lenges, practices, and beliefs in the online data research
community. In Proceedings of the 19th ACM Confer-
ence on Computer-Supported Cooperative Work & So-
cial Computing, pages 941–953.

Guillaume Wenzek, Marie-Anne Lachaux, Alexis Con-
neau, Vishrav Chaudhary, Francisco Guzmán, Armand
Joulin, and Edouard Grave. 2019. CCNet: Extracting
high quality monolingual datasets from web crawl data.
arXiv preprint arXiv:1911.00359.

Thomas Wolf, Lysandre Debut, Victor Sanh, Julien
Chaumond, Clement Delangue, Anthony Moi, Pierric
Cistac, Tim Rault, Rémi Louf, Morgan Funtowicz, Joe

19
The Pile- An 800GB Dataset of Diverse Text for Language Modeling