Answers.Body: <p>My take is that &quot;good&quot; pictures are not enough. Models like Stable Diffusion need <em>a lot</em> of data for training.</p>
  <p>Every picture helps the model to gain a deeper internal representation of images, and their relation with the provided caption and every single word in it.
  For example, LDM (on which Stable Diffusion) is trained on <a href="https://laion.ai/blog/laion-5b/" rel="nofollow noreferrer">LAION</a> dataset, which has 5 billion image-text pairs.  And the autoencoder component was also pretrained on another huge dataset.</p>
  <p>Having so many images helps the model to differentiate each context, and to represent the huge variety of concepts it can currently generate. It could also learn an internal representation that separates in some way &quot;good&quot; and &quot;ugly&quot; images.</p>
  
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2023-04-14T10:28:37.933Z
Answers.LastActivityDate: 2023-04-14T10:28:37.933Z
Answers.UserDisplayName: Ciodar
Answers.Body: <p>Broadly, your choices are to include or to exclude as much as possible.</p>
  <p>Who doubts that to include as much as possible is desirable?</p>
  <p>Who believes that to exclude anything without specific reason might be a very bad idea?</p>
  
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2023-04-12T22:43:13.480Z
Answers.LastActivityDate: 2023-04-12T22:43:13.480Z
Answers.UserDisplayName: Robbie Goodwin
Answers.Body: <p>&quot;Good training data&quot; does not refer to if the image is of a particular artist or resolution. Rather, &quot;good training data&quot; refers to data being curated to match the use-case.</p>
  <p>I'm confident Stable diffusion have had some kind of curated-quality test, for example on not training on a 100% white image.</p>
  
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2023-04-14T11:06:18.347Z
Answers.LastActivityDate: 2023-04-14T11:06:18.347Z
Answers.UserDisplayName: nammerkage
Body: <p>Stable Diffusion for example.
  Why train it on &quot;ugly&quot; pictures? Why not train a model on only the best and most awarded pictures with the best artist? wouldn't the final output have an overall better quality, instead of averaging in with &quot;lower quality&quot; pictures.</p>
  
Tags: <deep-learning><training>
Title: Why train models on all data available? Why not train on only the best?
UserDisplayName: icYou520
ThreadText: # Why train models on all data available? Why not train on only the best?
  
  (Asked by: username_0 on 2023-04-12)
  
  Stable Diffusion for example.
  Why train it on "ugly" pictures? Why not train a model on only the best and most awarded pictures with the best artist? wouldn't the final output have an overall better quality, instead of averaging in with "lower quality" pictures.
  
  **Tags:** deep-learning, training
  
  
  ---
  
  ## 3 answers
  
  ### Answer by username_1 on 2023-04-14. Score: 2
  
  My take is that "good" pictures are not enough. Models like Stable Diffusion need *a lot* of data for training.
  
  Every picture helps the model to gain a deeper internal representation of images, and their relation with the provided caption and every single word in it.
  For example, LDM (on which Stable Diffusion) is trained on [LAION](https://laion.ai/blog/laion-5b/) dataset, which has 5 billion image-text pairs. And the autoencoder component was also pretrained on another huge dataset.
  
  Having so many images helps the model to differentiate each context, and to represent the huge variety of concepts it can currently generate. It could also learn an internal representation that separates in some way "good" and "ugly" images.
  
  
  ---
  
  ### Answer by username_2 on 2023-04-12. Score: 0
  
  Broadly, your choices are to include or to exclude as much as possible.
  
  Who doubts that to include as much as possible is desirable?
  
  Who believes that to exclude anything without specific reason might be a very bad idea?
  
  
  ---
  
  ### Answer by username_3 on 2023-04-14. Score: 0
  
  "Good training data" does not refer to if the image is of a particular artist or resolution. Rather, "good training data" refers to data being curated to match the use-case.
  
  I'm confident Stable diffusion have had some kind of curated-quality test, for example on not training on a 100% white image.
  
  
  ---
  
  