Merity Stephen, Xiong Caiming, Bradbury James, and
Richard Socher. 2016.

Nisan Stiennon, Long Ouyang, Jeffrey Wu, Daniel
Ziegler, Ryan Lowe, Chelsea Voss, Alec Radford,
Dario Amodei, and Paul F Christiano. 2020. Learn-
ing to summarize with human feedback. Advances in
Neural Information Processing Systems, 33.

Pedro Javier Ortiz Suárez, Benoît Sagot, and Laurent
Romary. 2019a. Asynchronous pipeline for process-
ing huge corpora on medium to low resource infrastruc-
tures. In 7th Workshop on the Challenges in the Man-
agement of Large Corpora (CMLC-7). Leibniz-Institut
für Deutsche Sprache.

Pedro Javier Ortiz Suárez, Benoît Sagot, and Laurent
Romary. 2019b. Asynchronous pipeline for process-
ing huge corpora on medium to low resource infrastruc-
tures. In 7th Workshop on the Challenges in the Man-
agement of Large Corpora (CMLC-7). Leibniz-Institut
für Deutsche Sprache.
The Pile- An 800GB Dataset of Diverse Text for Language Modeling