Are you trying to load the model directly or the state_dict?
Could you push the model or state_dict to the CPU before storing it, load it in another script, and try to push it to the device later?
If this is working, the torch.load method might create the issue and would help us to debug it.