I had the same problem with with wp-gan. For some reasons, the gradient penalty increases quickly until it reaches inf.
Also, this happens for other gan too, e.g Self supervised gan. The behavior of loss function is also completely different when training with multi gpus.