Thanks for your reply.
Actually, I’ve modified their work to fit my domain, and so the pytorch work is comparable to this one:

  
      
      GitHub
  
  
    

saeedizadi/GAN_SKIN 10

GAN network for Skin Lesion Segmentation. Contribute to saeedizadi/GAN_SKIN development by creating an account on GitHub.


  
  
    
    
  
  


You can see that here I’ve switched the network to UNet which used ConvTranspose. I’ve also added BatchNorm to the unet model.
In addition, either SGD or Adam does not impact the problem.