@ptrblck So, I unplugged one of the RTX2080Ti, even though I wasn’t using it, and left the other one in. I restarted the machine and ran the same script with no issues occurring (with both cuDNN on and off):

image.png745×165 21.1 KB

However, I am not sure why the losses are different from the other machine, since we fixed the seed.