Answers.Body: <p>If you start to train a GAN in a way in which the discriminator becomes very powerful than the generator, then the training of generator will not be very much successful. In the same way, if the discriminator is too low in comparison with generator, it would let it produce any thing. So, either way, it will affect the training of the entire system.<br><br>
  So, if you see here, <code>both generator and discriminator and competing against each other</code> and on the other side they are dependent on each other for efficient training.<br><br>
  But I've read in a research paper that adding noise to discriminator is good for the overall stability. And sometimes people also change the labelling system as well. For instance, the value for YES is 1 and people change it to 0.9. This actually keeps the discriminator from being over confident.</p>
  
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2022-05-13T10:48:49.900Z
Answers.Text: It is only true for the original GAN loss. The SOTA approaches use different loss functions and regularization (WGAN-GP, R1 penalty)
Answers.UserDisplayName: Aray Karjauv
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2020-08-20T08:33:32.850Z
Answers.LastActivityDate: 2020-08-20T08:33:32.850Z
Answers.UserDisplayName: Neha Chaudhary
Body: <p>Since the discriminator defines how the generator is updated, then building a discriminator with a higher number of parameters/more layers should lead to a better quality of generated samples. So, assuming that it won't lead to overwhelming the generator (discriminator loss toward 0) or mode collapse, when engineering a GAN, I should build a discriminator as good as possible?</p>
  
Tags: <deep-learning><generative-adversarial-networks>
Title: Does a better discriminator in GANs mean better sample generation by the generator?
UserDisplayName: Daniel Wiczew
ThreadText: # Does a better discriminator in GANs mean better sample generation by the generator?
  
  (Asked by: username_0 on 2020-08-19)
  
  Since the discriminator defines how the generator is updated, then building a discriminator with a higher number of parameters/more layers should lead to a better quality of generated samples. So, assuming that it won't lead to overwhelming the generator (discriminator loss toward 0) or mode collapse, when engineering a GAN, I should build a discriminator as good as possible?
  
  **Tags:** deep-learning, generative-adversarial-networks
  
  ---
  
  ## 1 answers
  
  ### Answer by username_1 on 2020-08-20. Score: 0
  
  If you start to train a GAN in a way in which the discriminator becomes very powerful than the generator, then the training of generator will not be very much successful. In the same way, if the discriminator is too low in comparison with generator, it would let it produce any thing. So, either way, it will affect the training of the entire system.  
    
  So, if you see here, `both generator and discriminator and competing against each other` and on the other side they are dependent on each other for efficient training.  
    
  But I've read in a research paper that adding noise to discriminator is good for the overall stability. And sometimes people also change the labelling system as well. For instance, the value for YES is 1 and people change it to 0.9. This actually keeps the discriminator from being over confident.
  
  > **Comments:**
  > **username_2**: It is only true for the original GAN loss. The SOTA approaches use different loss functions and regularization (WGAN-GP, R1 penalty)  
  
  ---
  
  