Large Language Models, Quantization, Machine Learning, Data Science, Hands On Tutorials.
and K. Keutzer, A Survey of Quantization Methods for Efficient Neural Network Inference. 2021. H. Wu, P. Judd, X. Zhang, M. Isaev, and P. Micikevicius, Integer Quantization for Deep Learning Inference: Principles and Empirical Evaluation. 2020. Lilian Weng, Large Transformer Model Inference