[126] Lin, J., Tang, J., Tang, H., Yang, S., Dang, X., Han, S.: Awq: Activation-
aware weight quantization for llm compression and acceleration. arXiv preprint
arXiv:2306.00978 (2023)

[127] Dettmers, T., Svirschevski, R., Egiazarian, V., Kuznedelev, D., Frantar,
E., Ashkboos, S., Borzunov, A., Hoeﬂer, T., Alistarh, D.: Spqr: A sparse-
quantized representation for near-lossless llm weight compression. arXiv preprint
arXiv:2306.03078 (2023)

[128] Wei, X., Zhang, Y., Li, Y., Zhang, X., Gong, R., Guo, J., Liu, X.: Outlier sup-
pression+: Accurate quantization of large language models by equivalent and
optimal shifting and scaling. arXiv preprint arXiv:2304.09145 (2023)

[129] Kim, S., Hooper, C., Gholami, A., Dong, Z., Li, X., Shen, S., Mahoney,
M.W., Keutzer, K.: Squeezellm: Dense-and-sparse quantization. arXiv preprint
arXiv:2306.07629 (2023)

50
Beyond Efficiency