I read this interesting paper on game dynamics 3, which suggests using negative momentum for GAN training.
I wasn’t able to implement this in PyTorch using sgd as momentum < 0 is not accepted as an input to the optimizer.  Has anybody tried to implement this and figured out a workaround, or can offer any advice?
Thanks