Answers.Body: <p>It is possible to have both input and output be images that differ in a predictable way. For example, architectures similar to autoencoders have been used to remove blur, change weather conditions, change between day and night photos etc. In these architectures, the training data is matching pairs of images. If your goal is to replicate some image enhancement, then often the input is artificially processed e.g. to reduce its quality in a hard to reverse way. A good example of this would be to remove distortion or noise from an image.</p>
  
  <p>You can also use generative models. These are  harder to get working, but can be more flexible in that you don't need image pairs in order to train, just a set of images labelled with the traits that you want to learn. Converting an image using a generative model involves using an encoder stage to get its embedding, altering the embedding based on label you require and then feeding the new embedding into the decoder stage. This is how you might alter a face portrait from male to female, or young to old, because it is not possible to find good natural image pairs for that task.</p>
  
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2018-08-02T08:30:35.363Z
Answers.LastActivityDate: 2018-08-02T08:30:35.363Z
Answers.UserDisplayName: Neil Slater
Answers.Body: <p>Sure, for example for removing visual noise.
  Look up noise2noise by NVIDIA. The made a net that is capable of removing almost
  all noise from one picture.
  <a href="https://hothardware.com/news/nvidia-noise2noise-machine-learning-ai-magically-restores-your-grainy-photos" rel="nofollow noreferrer">https://hothardware.com/news/nvidia-noise2noise-machine-learning-ai-magically-restores-your-grainy-photos</a></p>
  
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2018-08-12T18:55:37.410Z
Answers.LastActivityDate: 2018-08-12T18:55:37.410Z
Answers.UserDisplayName: Evator
Body: <p>Is it possible to build a neural network that learns the connection between two images?</p>
  
  <p>Let's say I have a number of X images that related to Y images. How can I build a neural network that takes an image as an input and outputs (generates) the output image?</p>
  
  <p>The Y images are generated by applying some function to the X images.</p>
  
  <p>Do I need a generate neural network for that? Are conventional neural networks capable of classification only?</p>
  
Tags: <neural-networks>
Title: A neural network to learn the connection between two images
UserDisplayName: NueralNetsNoob
ThreadText: # A neural network to learn the connection between two images
  
  (Asked by: username_0 on 2018-08-01)
  
  Is it possible to build a neural network that learns the connection between two images?
  
  Let's say I have a number of X images that related to Y images. How can I build a neural network that takes an image as an input and outputs (generates) the output image?
  
  The Y images are generated by applying some function to the X images.
  
  Do I need a generate neural network for that? Are conventional neural networks capable of classification only?
  
  **Tags:** neural-networks
  
  
  ---
  
  ## 2 answers
  
  ### Answer by username_1 on 2018-08-02. Score: 2
  
  It is possible to have both input and output be images that differ in a predictable way. For example, architectures similar to autoencoders have been used to remove blur, change weather conditions, change between day and night photos etc. In these architectures, the training data is matching pairs of images. If your goal is to replicate some image enhancement, then often the input is artificially processed e.g. to reduce its quality in a hard to reverse way. A good example of this would be to remove distortion or noise from an image.
  
  You can also use generative models. These are harder to get working, but can be more flexible in that you don't need image pairs in order to train, just a set of images labelled with the traits that you want to learn. Converting an image using a generative model involves using an encoder stage to get its embedding, altering the embedding based on label you require and then feeding the new embedding into the decoder stage. This is how you might alter a face portrait from male to female, or young to old, because it is not possible to find good natural image pairs for that task.
  
  
  ---
  
  ### Answer by username_2 on 2018-08-12. Score: 1
  
  Sure, for example for removing visual noise.
  Look up noise2noise by NVIDIA. The made a net that is capable of removing almost
  all noise from one picture.
  <https://hothardware.com/news/nvidia-noise2noise-machine-learning-ai-magically-restores-your-grainy-photos>
  
  
  ---
  
  