I started playing around with new Amp interface. The thing is: I am training GANs and my models use spectral norm.
I would like to know how things work with mixed precision when using spectral norm. Are my spectraly normalized weights eligible for fp16 precision? Do I need to do something extra to get things working (such as increasing spectral norm eps?)
Thanks