@albanD, Now I see, the previous weights were updated and now it isn’t correct to backward relatively to them.
Ok, so my question is how to support that code with most similarity to it’s previous behavior on 1.4.0, i.e should I recalculate fake Gstep times, which is logical but pretty significant change relatively to it’s previous behavior or there is another solution ?
What happened in torch 1.4.0 when I did this (maybe I can read about it somewhere or you suggest to compare both torch versions repositories ?)
Thanks.
P.S generally I’ve heard that it is a common practice to do a few steps in one iteration training D and G, nut sure how to do it correctly with torch, especially in this version.