Once a model is quantized, you can push the model to the Hub with the [`~ModelMixin.push_to_hub`] method. The quantization `config.json` file is pushed first, followed by the quantized model weights. You can also save the serialized 8-bit models locally with [`~ModelMixin.save_pretrained`].  
</hfoption>
<hfoption id="4-bit">  
Quantizing a model in 4-bit reduces your memory-usage by 4x:  
bitsandbytes is supported in both Transformers and Diffusers, so you can can quantize both the