Once a model is quantized, you can push the model to the Hub with the [`~ModelMixin.push_to_hub`] method. The quantization `config.json` file is pushed first, followed by the quantized model weights. You can also save the serialized 4-bit models locally with [`~ModelMixin.save_pretrained`].  
</hfoption>
</hfoptions>  
<Tip warning={true}>  
Training with 8-bit and 4-bit weights are only supported for training *extra* parameters.  
</Tip>