I have been looking for a fix to this problem until I saw @smth 's comment which confirmed my suspicions about faulty nvidia driver. Thank you for that information btw!
I had a similar error in my case as well but I didn’t have multiple graphics cards to choose from. It was occurring in my laptop with gtx 1050ti. I am running PyTorch 1.3.1, cuda 10.1, cudnn 7.6.4 on Windows 10. Turns out that my nvidia driver was the root of my problem, so a quick downgrade from 441.66 to 431.86 fixed it! Although the downside of that seems to be longer runtime, for whatever reason.