It works for me as well when I use device = torch.device("cuda") and  the model works well! but when I use  torch.device("cpu") It throws the error mentioned above.
and model = torch.load("model.pt")  loads the right model that I want to test and works well in gpu.