I’m on ubuntu 16.04 with a Titan XP and the official nvidia cuda drivers and cudnn 6 (on the pytorch 0.2.0 release).
The code is the actual code I use right now (for every batch), thus I basically try not to get any NaNs (that’s why there is no not  ), but after roughly 10.000 runs/batches I have been at least once in the while part. My current x.size() is (64,1,32,32)
If I have some time, I’ll try to reproduce it in the docker image  .