betas=(args.adam_beta1, args.adam_beta2),
weight_decay=args.adam_weight_decay,
eps=args.adam_epsilon,
)
```  
Aside from setting up the LoRA layers, the training script is more or less the same as train_text_to_image.py!