Hi,
When you load a state dict, you load it into the current parameters of your network. So if the network is on cuda:0, the resulting net will be on cuda:0 as well.
The state dict contains Tensors and Tensors always have a device. That’s the only reason why it maintains device information.
In general, it should not be a problem to have them on different devices as whatever you asked for with .to() on the model is what counts. not what was in the state dict.