ZimoNitrome:

I am currently at work so I can’t share trainig results but this does indeed look like an improvement.


Freezing the parameters of the discriminator could yield a speed improvement but shouldn’t change the convergence since the gradients in D are zeroed out in each iteration (but you are right that the gradients are computed without being used).



 ZimoNitrome:

On another note, can we still train networks then even if they are in eval mode?


Yes, that’s possible.