Did you save the model itself or the state? You can check the if all params are on gpu or not by using
next(model.parameters()).is_cuda

I think best would be to load it on the gpu move it to the cpu and save again.