Could you explain your use case a bit more, i.e. which model is located on which GPU?
This error is raised, if you are trying to apply an operation using tensors, which are located on different devices. E.g. if modelA is on GPU0 and modelB on GPU1, you would have to make sure the output of modelA is transferred to GPU1 before passing it to the model.