I’m also curious about this, I mean you must have to train the GAN during the addtional iterations right? Otherwise how could the batchnorm parameters change?
Is another solution to just train the GAN for a few epochs at the end with a batch size of 1?