diffusers stable-diffusion stable-diffusion-diffusers text-to-image en arxiv:2305.13301 license:creativeml-openrail-m autotrain_compatible endpoints_compatible diffusers:StableDiffusionPipeline region:us
---
language:
- en
library_name: diffusers
license: creativeml-openrail-m
pipeline_tag: text-to-image
tags:
- stable-diffusion
- stable-diffusion-diffusers
- text-to-image
inference:
  parameters:
    num_inference_steps: 50
    guidance_scale: 5.0
    eta: 1.0
widget:
- text: lion
  example_title: lion
- text: butterfly
  example_title: butterfly
- text: dolphin
  example_title: dolphin
---

# ddpo-aesthetic

This model was finetuned from [Stable Diffusion v1-4](https:/CompVis/stable-diffusion-v1-4) using [DDPO](https://arxiv.org/abs/2305.13301) and a reward function based on the [LAION aesthetic predictor](https://laion.ai/blog/laion-aesthetics/). See [the project website](https://rl-diffusion.github.io/) for more details.

The model was finetuned for 40 iterations with a batch size of 256 samples per iteration. It was only prompted with the following list of 45 common animals during finetuning, so try those for the best results. However, we also observed limited generalization to other prompts.

Prompts:
- cat
- dog
- horse
- monkey
- rabbit
- zebra
- spider
- bird
- sheep
- deer
- cow
- goat
- lion
- tiger
- bear
- raccoon
- fox
- wolf
- lizard
- beetle
- ant
- butterfly
- fish
- shark
- whale
- dolphin
- squirrel
- mouse
- rat
- snake
- turtle
- frog
- chicken
- duck
- goose
- bee
- pig
- turkey
- fly
- llama
- camel
- bat
- gorilla
- hedgehog
- kangaroo