Answers.Body: <p>I'm not an expert on that so you could probably get a better answer.</p>
  
  <p>I'm not sure to understand what you're looking for. Are the couple of images about the same thing? Like pictures of cats and you want to generate a new cat based on these pictures? If that's what you want, you could probably take a look at <strong>Generative Adversarial Network</strong> (GAN) : <a href="http://blog.aylien.com/introduction-generative-adversarial-networks-code-tensorflow/" rel="nofollow noreferrer">Introduction</a>.
  A GAN is made up of a Generator and a Discriminator. The goal of the discriminator is to distinguish the real data from the generated data. And the goal of the generator is to improve its generated data to look similar to real data. Then, if there are different cat images in your dataset, the generator will learn to create a new cat based on that dataset.</p>
  
  <p>If what you're looking for is to take different images like a cat and a dog and generate a "catdog", you can take a look at <strong>Variational AutoEncoder</strong> (VAE). For example you can train two different VAE (Encoder/Decoder). One for cats, and one for dogs. Then you take the encoder of dogs and the decoder of cats. That what I saw one day, not sure if it really works.</p>
  
  <p>Correct me if I'm wrong</p>
  
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2019-05-22T09:12:54.327Z
Answers.Text: Thank you, that sounds like a good starting point. Actually it is about similiar images. Specifically, I want to feed the algorithm with pictures of stellar nebula and I am hoping to create new pictures of nebula by the algorithm. It's for a game project that I am working on.
Answers.UserDisplayName: Mark
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2019-05-22T09:27:42.680Z
Answers.Text: It probably exists some other methods that I don't know but GAN seems to be good here. To get a better idea, you can read this article ( https://towardsdatascience.com/image-generator-drawing-cartoons-with-generative-adversarial-networks-45e814ca9b6b) and replace Homer Simpson by stellar nebula.
Answers.UserDisplayName: Dlmss
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2019-05-22T08:44:29.047Z
Answers.LastActivityDate: 2019-05-22T09:07:16.780Z
Answers.LastEditDate: 2019-05-22T09:07:16.780Z
Answers.UserDisplayName: Dlmss
Answers.Body: <p>This was exactly what I was looking for;-) will be following!</p>
  <p>I do have something that might be of interest to you, an algorithm that generates pictures from textual input.
  Here is the link to the site where you can try it out:</p>
  <p><a href="https://hypnogram.xyz/" rel="nofollow noreferrer">https://hypnogram.xyz/</a></p>
  <p>Having played with it a little it seems that the text is used to search online and the pictures found online are then merged together according to a rule set.<br />
  But that is just a wild guess.
  It also seems that the images generated by the algorithm are unique and even when you use the same string twice the generated picture does not repeat itself. But again, that is what it seems like to someone who does not actually know,  I only recently stumbled on the site and have yet to read more about the process.
  Enjoy!</p>
  
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2023-01-02T20:15:35.493Z
Answers.Text: But this doesn't allow to use an image as input ...
Answers.UserDisplayName: Martin Braun
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2022-03-03T15:34:32.180Z
Answers.LastActivityDate: 2022-03-03T15:34:32.180Z
Answers.UserDisplayName: TJx
Answers.Body: <p>I'm not an expert and I'm aware this is an old question so you've probably found something of interest since.</p>
  <p>For latecomers, an interesting lead could be <a href="https://github.com/lllyasviel/ControlNet" rel="nofollow noreferrer">ControlNET</a>, an extension for Stable Diffusion. This extension includes various models to analyze an input image and control the output. Some of the models include detection of pose, depth, contours... It's extremely useful to create iterations of an existing image, which seems to be your objective.</p>
  
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2023-05-19T13:14:35.107Z
Answers.LastActivityDate: 2023-05-19T13:14:35.107Z
Answers.UserDisplayName: curious
Body: <p>Are there any open sourced algorithms that can take a couple of images as an input and generate a new, similar image based on that input? Or are there any resources where I can learn to create such an algorithm?</p>
  
Tags: <neural-networks><algorithm><image-generation><art-aesthetics>
Title: Algorithm that creates new images based on other images
UserDisplayName: Mark
ThreadText: # Algorithm that creates new images based on other images
  
  (Asked by: username_0 on 2019-05-22)
  
  Are there any open sourced algorithms that can take a couple of images as an input and generate a new, similar image based on that input? Or are there any resources where I can learn to create such an algorithm?
  
  **Tags:** neural-networks, algorithm, image-generation, art-aesthetics
  
  ---
  
  ## 3 answers
  
  ### Answer by username_1 on 2019-05-22. Score: 2
  
  I'm not an expert on that so you could probably get a better answer.
  
  I'm not sure to understand what you're looking for. Are the couple of images about the same thing? Like pictures of cats and you want to generate a new cat based on these pictures? If that's what you want, you could probably take a look at **Generative Adversarial Network** (GAN) : [Introduction](http://blog.aylien.com/introduction-generative-adversarial-networks-code-tensorflow/).
  A GAN is made up of a Generator and a Discriminator. The goal of the discriminator is to distinguish the real data from the generated data. And the goal of the generator is to improve its generated data to look similar to real data. Then, if there are different cat images in your dataset, the generator will learn to create a new cat based on that dataset.
  
  If what you're looking for is to take different images like a cat and a dog and generate a "catdog", you can take a look at **Variational AutoEncoder** (VAE). For example you can train two different VAE (Encoder/Decoder). One for cats, and one for dogs. Then you take the encoder of dogs and the decoder of cats. That what I saw one day, not sure if it really works.
  
  Correct me if I'm wrong
  
  > **Comments:**
  > **username_0**: Thank you, that sounds like a good starting point. Actually it is about similiar images. Specifically, I want to feed the algorithm with pictures of stellar nebula and I am hoping to create new pictures of nebula by the algorithm. It's for a game project that I am working on.  
  > **username_1**: It probably exists some other methods that I don't know but GAN seems to be good here. To get a better idea, you can read this article ( https://towardsdatascience.com/image-generator-drawing-cartoons-with-generative-adversarial-networks-45e814ca9b6b) and replace Homer Simpson by stellar nebula.  
  
  ---
  
  ### Answer by username_2 on 2022-03-03. Score: 1
  
  This was exactly what I was looking for;-) will be following!
  
  I do have something that might be of interest to you, an algorithm that generates pictures from textual input.
  Here is the link to the site where you can try it out:
  
  <https://hypnogram.xyz/>
  
  Having played with it a little it seems that the text is used to search online and the pictures found online are then merged together according to a rule set.  
  But that is just a wild guess.
  It also seems that the images generated by the algorithm are unique and even when you use the same string twice the generated picture does not repeat itself. But again, that is what it seems like to someone who does not actually know, I only recently stumbled on the site and have yet to read more about the process.
  Enjoy!
  
  > **Comments:**
  > **username_3**: But this doesn't allow to use an image as input ...  
  
  ---
  
  ### Answer by username_4 on 2023-05-19. Score: 1
  
  I'm not an expert and I'm aware this is an old question so you've probably found something of interest since.
  
  For latecomers, an interesting lead could be [ControlNET](https://github.com/lllyasviel/ControlNet), an extension for Stable Diffusion. This extension includes various models to analyze an input image and control the output. Some of the models include detection of pose, depth, contours... It's extremely useful to create iterations of an existing image, which seems to be your objective.
  
  
  ---
  
  