<hfoptions id="gpu-select">
<hfoption id="16GB">  
On a 16GB GPU, you can use bitsandbytes 8-bit optimizer and gradient checkpointing to optimize your training run. Install bitsandbytes:  
```py
pip install bitsandbytes
```  
Then, add the following parameter to your training command:  
```bash
accelerate launch train_controlnet.py \
--gradient_checkpointing \
--use_8bit_adam \
```  
</hfoption>
<hfoption id="12GB">