Actually sneaky, sneaky… there was another problem. This one I do not understand. With batchNorm on each layer, the Discriminator loss gets stuck at ~0.69. I do not know why but when I switch my normalization method to dropout everything starts working.
This person has had a similar experience:

  
      datascience.stackexchange.com
  
  
      
    
  

  DC GAN with Batch Normalization not working 128



  training, gan, mnist



  
  answered by
  
    Nagabhushan S N
  
  on 02:21PM - 03 Aug 19 UTC