@albanD, didn’t I detached it calling backward on errD_fake ?
hm … although it is used in the gradient penalty with backward on ‘fake’.
So you were talking about the fake modification in the ‘gradient penalty’ backward.
But the Generator 3 steps occur only after the previous Discriminator finished it 3 steps,
and the first iteration is successful as I’ve wrote in the clarification, so it isn’t make sense to me.
P.S just a clarrification when the error happens:
The for loop on D.steps finishes it’s 3 steps and then the for loop on Gsteps runs once successfully, and in the second iteration fails with the error (of total 3 steps it suppose to do). All of that in the first epoch (each epoch does 3 steps on each of the models Generator-Discriminator)
.
Any suggestions maybe how to support its behavior when it ran on torch 1.4.0 ? Also will be great.