Very interesting! Thanks for sharing the tip
I have tried it in my code and it does not much different when using eval during training. Just one question, do we need train G in the additional_iters @smth ? Thanks
# Now run generation for a few min-batch while keeping the mode as "train"
 for _ in range(additional_iters): 
      z = ... # sample a z
       _ = G(z)
      # Do we need train G here without train D?