@smth, @albanD, ptrblck - I read your posts a lot and it seems like there isn’t anyting about pytorch you don’t know - Perhaps you can take a look?
I would think this should have a lot of interest from the community, as I expect anyone training GANs to run into similar problems.
Thanks.