Hi, I came across a problem:
I am running the same model on 2 different machines, one is a single GPU 1080Ti and the other one is 2x GPUs RTX2080Ti, but the model is running on a single 2080Ti.
The problem is that the model runs just fine on my single 1080Ti GPU, however, when the model is run on the other machine I get nan for losses:

image.png719×62 5.73 KB

If anyone has experienced this weird behavior, please advise on what the problem may be.
PS. The both machines are running PyTorch 1.0.0, CUDA 10 and cuDNN 7.4.