I get this same issue on RTX 2080 Ti. I am using Cuda 9.0, Pytorch 1.0 and I have tried with cuDNN 7.0 and 7.4. I had two questions. First is the error gets resolved on the second attempt. When I enclose model.to(device) inside a try catch and make it run again on the exception, it works. This seems quite strange. This also happened when I tried doing this through the Python shell. The second thing is what does the command torch.backends.cudnn.version() mean. I ran it when with cuDNN 7.0 and 7.4 and both times I got 7401? Thanks.