Solved by albanD in post #2 
              
              
                Hi, 
This is surprising indeed given the code you shared. 
Are you sure that you don’t save any state that you re-use in the gan_loss or the discriminator?