Machine Learning, Transformers, Data Science, Python, Hugging Face.
just in case you think this could be more “trickier” than with other models, we will show you that it is as usual. Remember you need to load all the libraries, including optimum, accelerate, and, of course, auto-gptq . !pip install -q -U transformers peft accelerate optimum !pip install auto-gptq