Ok, right. So it’s hard to say what is wrong without your code. But if I understand what you want to do (load one model on one gpu, second model on second gpu, and pass some input through them) I think the proper way to do this, and one that works for me is:
# imports
import torch

# define models
m0 = torch.nn.Linear(10,5)
m1 = torch.nn.Linear(10,5)

# define devices
d0 = torch.device("cuda:0")
d1 = torch.device("cuda:1")

# define tensors
t0 = torch.rand(10)
t1 = torch.rand(10)

# move to devices
t0 = t0.to(d0)
t1 = t1.to(d1)
m0 = m0.to(d0)
m1 = m1.to(d1)

# forward pass
out0 = m0(t0)
out1 = m1(t1)