Aitor Lewkowycz, Anders

Johan Andreassen,
David Dohan, Ethan Dyer, Henryk Michalewski,
Vinay Venkatesh Ramasesh, Ambrose Slone, Cem
Anil, Imanol Schlag, Theo Gutman-Solo, Yuhuai
Wu, Behnam Neyshabur, Guy Gur-Ari, and Vedant
Misra. 2022. Solving quantitative reasoning prob-
lems with language models. In Advances in Neural
Information Processing Systems.

Opher Lieber, Or Sharir, Barak Lenz, and Yoav
Jurassic-1: Technical details and

Shoham. 2021.
evaluation. White Paper. AI21 Labs, 1.

Stephanie Lin, Jacob Hilton, and Owain Evans. 2021.
Truthfulqa: Measuring how models mimic human
falsehoods. arXiv preprint arXiv:2109.07958.

Ilya Loshchilov and Frank Hutter. 2017. Decou-
pled weight decay regularization. arXiv preprint
arXiv:1711.05101.

Matthew V Mahoney. 1999. Text compression as a test

for artiﬁcial intelligence. AAAI/IAAI, 970.
LLaMA- Open and Efficient Foundation Language Models