[31] Mihir Prabhudesai, Anirudh Goyal, Deepak Pathak, and
Katerina Fragkiadaki. Aligning text-to-image diffusion
arXiv preprint
models with reward backpropagation.
arXiv:2310.03739, 2023. 1, 3

[32] Alec Radford, Jong Wook Kim, Chris Hallacy, Aditya
Ramesh, Gabriel Goh, Sandhini Agarwal, Girish Sastry,
Amanda Askell, Pamela Mishkin, Jack Clark, et al. Learning
transferable visual models from natural language supervi-
sion. In International conference on machine learning, pages
8748–8763. PMLR, 2021. 6, 1

[33] Rafael Rafailov, Archit Sharma, Eric Mitchell, Stefano Er-
mon, Christopher D. Manning, and Chelsea Finn. Direct
preference optimization: Your language model is secretly a
reward model, 2023. 1, 2, 3, 4, 5, 8
DiffusionModelAlignmentUsing Direct Preference Optimization