multiplication for transformers at scale. arXiv preprint arXiv:2208.07339, 2022.

Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. BERT: Pre-training of deep
bidirectional transformers for language understanding. In North American Chapter of the Associ-
ation for Computational Linguistics (NAACL), 2019.

Elias Frantar, Eldar Kurtic, and Dan Alistarh. M-FAC: Efﬁcient matrix-free approximations of
second-order information. In Conference on Neural Information Processing Systems (NeurIPS),
2021.

Elias Frantar, Sidak Pal Singh, and Dan Alistarh. Optimal Brain Compression: A framework for ac-
curate post-training quantization and pruning. arXiv preprint arXiv:2208.11580, 2022. Accepted
to NeurIPS 2022, to appear.

Amir Gholami, Sehoon Kim, Zhen Dong, Zhewei Yao, Michael W Mahoney, and Kurt Keutzer.
arXiv preprint

A survey of quantization methods for efﬁcient neural network inference.
arXiv:2103.13630, 2021.
GPTQ