thanks for your reply. If by default everything is put on device 0, why I am getting that error? because while running, I didn’t set any cuda device specifically. By the way, I have two questions.


Suppose I am running on two different devices (different GPUs - GeForce and Titan-X) and also using DataParallel as per pytorch examples, do I need to make sure that I run in same type of GPUs to avoid unusual problems?


Say, I have trained my model in GeForce GPU and saved it using state_dict() and then loaded them model in a different GPU (Titan-x), am I going to face any problem?


Sometimes, I get some weird errors because of these GPU issues and I don’t know how to solve it. It would be very helpful, if anyone can write some notes/blogs on the problems that one can make in these cases.