Answers.Body: <p>Check out <a href="https://github.com/DmitryUlyanov/deep-image-prior" rel="nofollow noreferrer">source code to DeepImagePrior</a> it does a remarkable job guessing what's missing to repair images with a variety of damage. </p>
  
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2019-01-02T20:09:14.643Z
Answers.LastActivityDate: 2019-01-02T20:09:14.643Z
Answers.UserDisplayName: Julian H
Answers.Body: <p>I've answered a part of the question below, i.e. can the photo/video be decompressed in theory?</p>
  
  <p>If the RGB values are continuous (well behaved function), interpolation should generate the pixels in between them in a predictable pattern like say in old pictures of models where skin color shades and data is available in plenty for models today and they resemble each other whereas in outlier cases like this picture where the designs of cockpit circular meter maybe different for each plane or maybe too much data is lost say of a distant object, no neural network should be able to fix it because the possibilities of an orange blur can be an orange, a sun or many other things.</p>
  
  <p>One of the solutions to such things can be recognizing context but finding sufficiently dense pixels so exact should be difficult (I think impossible) because sun will be very bright but orange might have some spots.</p>
  
  <p>In short, average things can be done, not outliers.</p>
  
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2018-12-01T09:27:24.437Z
Answers.LastActivityDate: 2018-12-01T09:27:24.437Z
Answers.UserDisplayName: sagar_acharya
Body: <p>So let's say you had a really nice day in a flight simulator and you are getting videos of this type of quality:</p>
  
  <p><a href="https://i.sstatic.net/ftsYV.png" rel="noreferrer"><img src="https://i.sstatic.net/ftsYV.png" alt="A snapshot of the compressed video"></a></p>
  
  <p>This is Full HD (1080p), but heavily compressed. You can literally see the pixels. Now I tried to use something like RAISR, and this <a href="https://github.com/hugopilot/raisr" rel="noreferrer">python implementation</a>, but it only scales the image up and does not 'fix the thicc pixels'. </p>
  
  <p>So is there a type of AI that does fix this kind of video/photo into a reasonable quality video? I just want to get rid of those pixels and image artefacts that was generated during the compression.</p>
  
Comments.ContentLicense: CC BY-SA 4.0
Comments.CreationDate: 2018-10-14T19:58:09.783Z
Comments.Text: Although there are AI techniques that can do this sort of thing, this Stack Exchange is not for questions looking for implementations. It is for questions about the nuts and bolts or how they work, or even the philosophy of whether or not we could or should build "intelligent" machines. If you are willing to learn enough about neural networks and invest a few weeks or months into researching and writing an algorithm to de-pixelate images, then you are in the right place. If you just want to fix your image, then sorry no - I believe there are projects out there that might help though.
Comments.UserDisplayName: Neil Slater
Comments.ContentLicense: CC BY-SA 4.0
Comments.CreationDate: 2018-10-15T07:21:27.760Z
Comments.Text: @NeilSlater I am always open to design new algorithms. I just wondered if there was already such algorithm out there.
Comments.UserDisplayName: Hugo Woesthuis
Comments.ContentLicense: CC BY-SA 4.0
Comments.CreationDate: 2018-10-15T07:24:56.820Z
Comments.Text: Yes the algorithm is out there, it is not much different to super-resolution, and implementations are available if you search. At one point I am pretty sure I have used a NN trained to de-block an image on my own graphics. If you are interested in studying the algorithm, could you please make that clearer in the question, explaining what you know already?
Comments.UserDisplayName: Neil Slater
Comments.ContentLicense: CC BY-SA 4.0
Comments.CreationDate: 2018-10-15T07:32:49.223Z
Comments.Text: Here's one example of an algorithm built to do what you want: https://arxiv.org/pdf/1709.06229.pdf
Comments.UserDisplayName: Neil Slater
Comments.ContentLicense: CC BY-SA 4.0
Comments.CreationDate: 2018-10-15T07:45:33.460Z
Comments.Text: @NeilSlater Very interesting! Never heard of it lol.
Comments.UserDisplayName: Hugo Woesthuis
Tags: <machine-learning><deep-learning>
Title: Can AI 'fix' heavily compessed videos/photos?
UserDisplayName: Hugo Woesthuis
ThreadText: # Can AI 'fix' heavily compessed videos/photos?
  
  (Asked by: username_0 on 2018-10-14)
  
  So let's say you had a really nice day in a flight simulator and you are getting videos of this type of quality:
  
  [![A snapshot of the compressed video](https://i.sstatic.net/ftsYV.png)](https://i.sstatic.net/ftsYV.png)
  
  This is Full HD (1080p), but heavily compressed. You can literally see the pixels. Now I tried to use something like RAISR, and this [python implementation](https://github.com/hugopilot/raisr), but it only scales the image up and does not 'fix the thicc pixels'.
  
  So is there a type of AI that does fix this kind of video/photo into a reasonable quality video? I just want to get rid of those pixels and image artefacts that was generated during the compression.
  
  **Tags:** machine-learning, deep-learning
  
  > **Comments:**
  > **username_1**: Although there are AI techniques that can do this sort of thing, this Stack Exchange is not for questions looking for implementations. It is for questions about the nuts and bolts or how they work, or even the philosophy of whether or not we could or should build "intelligent" machines. If you are willing to learn enough about neural networks and invest a few weeks or months into researching and writing an algorithm to de-pixelate images, then you are in the right place. If you just want to fix your image, then sorry no - I believe there are projects out there that might help though.  
  > **username_0**: @username_1 I am always open to design new algorithms. I just wondered if there was already such algorithm out there.  
  > **username_1**: Yes the algorithm is out there, it is not much different to super-resolution, and implementations are available if you search. At one point I am pretty sure I have used a NN trained to de-block an image on my own graphics. If you are interested in studying the algorithm, could you please make that clearer in the question, explaining what you know already?  
  > **username_1**: Here's one example of an algorithm built to do what you want: https://arxiv.org/pdf/1709.06229.pdf  
  > **username_0**: @username_1 Very interesting! Never heard of it lol.  
  
  ---
  
  ## 2 answers
  
  ### Answer by username_2 on 2019-01-02. Score: 1
  
  Check out [source code to DeepImagePrior](https://github.com/DmitryUlyanov/deep-image-prior) it does a remarkable job guessing what's missing to repair images with a variety of damage.
  
  
  ---
  
  ### Answer by username_3 on 2018-12-01. Score: 0
  
  I've answered a part of the question below, i.e. can the photo/video be decompressed in theory?
  
  If the RGB values are continuous (well behaved function), interpolation should generate the pixels in between them in a predictable pattern like say in old pictures of models where skin color shades and data is available in plenty for models today and they resemble each other whereas in outlier cases like this picture where the designs of cockpit circular meter maybe different for each plane or maybe too much data is lost say of a distant object, no neural network should be able to fix it because the possibilities of an orange blur can be an orange, a sun or many other things.
  
  One of the solutions to such things can be recognizing context but finding sufficiently dense pixels so exact should be difficult (I think impossible) because sun will be very bright but orange might have some spots.
  
  In short, average things can be done, not outliers.
  
  
  ---
  
  