Answers.Body: <p>I am a bit later to this but in short yes you can. The approach of training on synthetic data and transfer that knowledge to real data is called <em>sim2real gap</em> (borrowed from RL) and for computer vision you can now hear <em>synth2real gap</em>.</p>
  <p>Microsoft has been working on that for a while (they do not have faces dataset) and it has published some relevant papers on it:</p>
  <ul>
  <li><a href="https://arxiv.org/abs/2109.15102" rel="nofollow noreferrer">Fake It Till You Make It</a></li>
  <li><a href="https://arxiv.org/abs/2204.02776" rel="nofollow noreferrer">3D face reconstruction with dense landmarks</a></li>
  </ul>
  <p>There are also other approaches using GANs for face generation, although realism is boosted GANs suffer from micro glitches in the images that biases the training data. But even with that glitches you can successfully train.</p>
  <p>You can also measure the knowledge transfer by computing some metrics on some public face datasets such as WIDER-FACE.</p>
  
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2022-04-20T12:33:22.043Z
Answers.LastActivityDate: 2022-04-20T12:33:22.043Z
Answers.UserDisplayName: JVGD
Body: <p>In order to train a face recognition system you need to have access to a large database with thousands of photos containing different faces. Companies like facebook and amazon have these databases but most average people do not.</p>
  <p>If you don't have access to a sufficiently large dataset with faces, could you use computer generated random faces instead? I'm asking this because computers are becoming better and better in rendering hyper realistic faces. An example is the <a href="https://www.youtube.com/watch?v=6MIkoLBWRv0" rel="nofollow noreferrer">meetmike digital human showcase video.</a> Another example is the <a href="https://www.youtube.com/watch?v=9owTAISsvwk" rel="nofollow noreferrer">unreal engine project spotlight video.</a>. Lastly you also have websites like <a href="https://thispersondoesnotexist.com/" rel="nofollow noreferrer">https://thispersondoesnotexist.com/</a> that can generate random faces.</p>
  <p>What if you generate a couple of photos of the same computer generated face and you make sure that each photo shows the face in a different setting or from a different angle. Could you then use such photos to train a facial recognition system that can accurately recognize real people?</p>
  
Comments.ContentLicense: CC BY-SA 4.0
Comments.CreationDate: 2021-08-26T03:03:26.857Z
Comments.Text: It sounds plausible. The catch is, to train a generator for human faces, you need to have a lot of face images anyway. So, you might directly train a face recognition on that set. However, if you don't have your own dataset, but only has access to a pretrained face generator model, what you describe makes sense to me.
Comments.UserDisplayName: SpiderRico
Tags: <face-recognition><face-detection>
Title: Can a face recognition system be trained using only computer generated hyper realistic faces?
UserDisplayName: Maurice
ThreadText: # Can a face recognition system be trained using only computer generated hyper realistic faces?
  
  (Asked by: username_0 on 2021-08-25)
  
  In order to train a face recognition system you need to have access to a large database with thousands of photos containing different faces. Companies like facebook and amazon have these databases but most average people do not.
  
  If you don't have access to a sufficiently large dataset with faces, could you use computer generated random faces instead? I'm asking this because computers are becoming better and better in rendering hyper realistic faces. An example is the [meetmike digital human showcase video.](https://www.youtube.com/watch?v=6MIkoLBWRv0) Another example is the [unreal engine project spotlight video.](https://www.youtube.com/watch?v=9owTAISsvwk). Lastly you also have websites like <https://thispersondoesnotexist.com/> that can generate random faces.
  
  What if you generate a couple of photos of the same computer generated face and you make sure that each photo shows the face in a different setting or from a different angle. Could you then use such photos to train a facial recognition system that can accurately recognize real people?
  
  **Tags:** face-recognition, face-detection
  > **Comments:**
  > **username_1**: It sounds plausible. The catch is, to train a generator for human faces, you need to have a lot of face images anyway. So, you might directly train a face recognition on that set. However, if you don't have your own dataset, but only has access to a pretrained face generator model, what you describe makes sense to me.  
  
  ---
  
  ## 1 answers
  
  ### Answer by username_2 on 2022-04-20. Score: 1 | Accepted answer
  
  I am a bit later to this but in short yes you can. The approach of training on synthetic data and transfer that knowledge to real data is called *sim2real gap* (borrowed from RL) and for computer vision you can now hear *synth2real gap*.
  
  Microsoft has been working on that for a while (they do not have faces dataset) and it has published some relevant papers on it:
  
  * [Fake It Till You Make It](https://arxiv.org/abs/2109.15102)
  * [3D face reconstruction with dense landmarks](https://arxiv.org/abs/2204.02776)
  
  There are also other approaches using GANs for face generation, although realism is boosted GANs suffer from micro glitches in the images that biases the training data. But even with that glitches you can successfully train.
  
  You can also measure the knowledge transfer by computing some metrics on some public face datasets such as WIDER-FACE.
  
  
  ---
  
  