I am wondering the same thing. Even while updating the Generator, if I have more terms in the Generator loss apart from the errG in the DCGAN example, should I call backward() for both the components separately or combine them and call backwards once?
What exactly happens on calling backwards() multiple times, does it calculate the gradients twice with respect to the same weights based on the criterion or does the second call calculate gradients on top of the gradients calculated in the first call.
Looking for answers!
Cheers,
Nabarun