Solved by mmisiur in post #4 
              
              
                Ok, right. So it’s hard to say what is wrong without your code. But if I understand what you want to do (load one model on one gpu, second model on second gpu, and pass some input through them) I think the proper way to do this, and one that works for me is: 
# imports
import torch

# define models
…