Solved by ptrblck in post #2 
              
              
                You can use the map_location argument in torch.load to map your GPU tensors to the CPU as explained in the note section. 
Alternatively you could of course push the model to the CPU before saving its state_dict.