I haven’t seen these failures before and other GAN arhcitectures, such as Pix2PixHD 2 don’t seem to need any changes additional changes for mixed-precision training.
CC @mcarilli in case he’s seen some GAN failures before.