Denis Paperno, Germán Kruszewski, Angeliki Lazaridou, Ngoc Quan Pham, Raﬀaella Bernardi, Sandro
Pezzelle, Marco Baroni, Gemma Boleda, and Raquel Fernández. The LAMBADA dataset: Word prediction
requiring a broad discourse context. In Proceedings of the 54th Annual Meeting of the Association for Computa-
tional Linguistics (Volume 1: Long Papers), pages 1525–1534, Berlin, Germany, August 2016. Association for
Computational Linguistics. doi: 10.18653/v1/P16-1144. URL https://aclanthology.org/P16-1144.

Ravsehaj Singh Puri, Swaroop Mishra, Mihir Parmar, and Chitta Baral. How many data samples is an
additional instruction worth? arXiv preprint arXiv:2203.09161, 2022. URL https://arxiv.org/abs/2203.
09161.

Mahima Pushkarna, Andrew Zaldivar, and Oddur Kjartansson. Data cards: Purposeful and transparent
In Data-centric AI Workshop at NeurIPS, 2021. URL https:

dataset documentation for responsible ai.
//arxiv.org/abs/2204.01075.
Scaling Instruction-Finetuned Language Models