It's been a while we shipped native quantization support in 
text
It's been a while we shipped native quantization support in 
diffusers
`diffusers`
inline_code
 🧨
text
 🧨
new_line
new_line
We currently support 
text
We currently support 
bistandbytes
`bistandbytes`
inline_code
 as the official backend but using others like 
text
 as the official backend but using others like 
torchao
`torchao`
inline_code
 is already very simple. 
text
 is already very simple. 
new_line
new_line
This post is just a reminder of what's possible:
text
This post is just a reminder of what's possible:
new_line
new_line
1. Loading a model with a quantization config
text
1. Loading a model with a quantization config
new_line
2. Saving a model with quantization config
text
2. Saving a model with quantization config
new_line
3. Loading a pre-quantized model
text
3. Loading a pre-quantized model
new_line
4. 
text
4. 
enable_model_cpu_offload()
`enable_model_cpu_offload()`
inline_code
new_line
5. Training and loading LoRAs into quantized checkpoints
text
5. Training and loading LoRAs into quantized checkpoints
new_line
new_line
Docs:
text
Docs:
new_line
https://huggingface.co/docs/diffusers/main/en/quantization/bitsandbytes
https://huggingface.co/docs/diffusers/main/en/quantization/bitsandbytes
link
It's been a while we shipped native quantization support in `diffusers` 🧨

We currently support `bistandbytes` as the official backend but using others like `torchao` is already very simple. 

This post is just a reminder of what's possible:

1. Loading a model with a quantization config
2. Saving a model with quantization config
3. Loading a pre-quantized model
4. `enable_model_cpu_offload()`
5. Training and loading LoRAs into quantized checkpoints

Docs:
https://huggingface.co/docs/diffusers/main/en/quantization/bitsandbytes
❤️
s3nh YaTharThShaRma999 davidberenstein1957 John6666 clem merve lunarflu not-lain pcuenq KarthikaRajagopal
🚀
John6666 clem lunarflu rwightman not-lain den0620 pcuenq OmbelineM ai-everyday
61caeda441f9432649f03ab6
https://cdn-avatars.huggingface.co/v1/production/uploads/61caeda441f9432649f03ab6/IazJBCi7Cr34DgZXZeI4k.jpeg
s3nh
s3nh
user