I’ve had similar results …

Screen Shot 2019-05-31 at 3.19.31 PM.png1890×954 291 KB

Maybe this is simply due to the instability of the GAN? I’ve heard this downside thrown around a lot when discussing GANs