models. arXiv preprint arXiv:1609.07843, 2016.

Markus Nagel, Rana Ali Amjad, Mart Van Baalen, Christos Louizos, and Tijmen Blankevoort. Up or
down? Adaptive rounding for post-training quantization. In International Conference on Machine
Learning (ICML), 2020.

Markus Nagel, Marios Fournarakis, Rana Ali Amjad, Yelysei Bondarenko, Mart van Baalen,
arXiv preprint

and Tijmen Blankevoort. A white paper on neural network quantization.
arXiv:2106.08295, 2021.

Yury Nahshan, Brian Chmiel, Chaim Baskin, Evgenii Zheltonozhskii, Ron Banner, Alex M Bron-
stein, and Avi Mendelson. Loss aware post-training quantization. Machine Learning, 110(11):
3245–3262, 2021.

Denis Paperno, Germ´an Kruszewski, Angeliki Lazaridou, Quan Ngoc Pham, Raffaella Bernardi,
Sandro Pezzelle, Marco Baroni, Gemma Boleda, and Raquel Fern´andez. The LAMBADA dataset:
Word prediction requiring a broad discourse context. arXiv preprint arXiv:1606.06031, 2016.

11

Published as a conference paper at ICLR 2023
GPTQ