Check the .device attribute of the model parameters as well as the input data in the forward method of your model and try to isolate which tensor creates the device mismatch.
Once this is done, check how this tensor/parameter is created and if you are manually pushing this tensor to a specific device instead of letting nn.DataParallel handle it.