Unrolling adversarial networks
Hi, Is the point that we simulate optimisation of the discriminator for K steps, then use the final error at D to optimise the parameters of D from before we started unrolling? Does this mean we have to store a copy of D’s parameters before we start the unrolling procedure? Does this mean that we end up discarding all the optimisation changes that occurred during unrolling? (Excluding the fact that they are implicitly bundled into the final output from the unrolling). Also, do we unroll for both real and fake data through D, or just fake data? Any help with this would be very much appreciated, cheers!
Jordan_Campbell
I don’t really know how unrolled GANs work, but as far as I remember they require taking gradient of functions of another gradient, and we don’t support that yet. It’s on our roadmap and we’re actively working on that, but it might take us some time.
apaszke
Jordan_Campbell
this is supported now right? How can it be done?
prolearner
Best regards Thomas
tom
Does it support recurrent modules using Pytorch 1.0 now ?
lewiskit