Machine Learning, Transformers, Data Science, Python, Hugging Face.
GPU in Colab. It takes about 45 minutes to quantize the model, less than $1 in Colab. You can find the code in this notebook in my repository. First, we need to install the libraries as it is recommended in the huggingface tutorial: !pip install -q -U transformers peft accelerate optimum !pip