Machine Learning, Transformers, Data Science, Python, Hugging Face.
notebook in my repository. Any suggestion or bug fixing is welcome. References [1] ICLR 2023 paper “GPTQ: Accurate Post-Training Quantization for Generative Pre-Trained Transformers” [2] “GPTQ or bitsandbytes: Which Quantization Method to Use for LLMs — Examples with Llama 2” by Benjamin Marie. [3]