A galaxy-colored figurine is floating over the sea at sunset, photorealisticA smiling beautiful sorceress wearing a high necked blue suit surrounded by swirling rainbow aurora, hyper-realistic, cinematic, post-productionA monk in an orange robe by a round window in a spaceship in dramatic lightingConcept art of a mythical sky alligator with wings, nature documentaryAnthropmorphic koala teaching a college classSDXLDPO-SDXLDPO-SDXLSDXLFigure 4. DPO-SDXL (base only) significantly outperforms the much larger SDXL-(base+refinement) model pipeline in human evaluations
on the PartiPrompts and HPS datasets. While the SDXL refinement model is used to touch up details from the output of SDXL-base, the
ability to generate high quality details has been naturally distilled into DPO-SDXL by human preference. Among other advantages,
DPO-SDXL shows superior generation of anatomical features such as teeth, hands, and eyes. Prompts: close up headshot, steampunk
DiffusionModelAlignmentUsing Direct Preference Optimization