<hfoptions id="bnb">
<hfoption id="8-bit">  
Quantizing a model in 8-bit halves the memory-usage:  
bitsandbytes is supported in both Transformers and Diffusers, so you can quantize both the
[`FluxTransformer2DModel`] and [`~transformers.T5EncoderModel`].  
For Ada and higher-series GPUs. we recommend changing `torch_dtype` to `torch.bfloat16`.  
> [!TIP]