In the pix2pix code that can be found here 1 first the generator is trained and then the discriminator. My question is, aren’t the gradients calculated loss_D.backward() accumulated in the training of the generator in the next loop? Shouldn’t we use zero_grad on the discriminator again before training the generator?