Solved by ptrblck in post #2 
              
              
                Could you try to load the checkpoints onto the CPU first using the map_location argument in torch.load? 
After it was successful, try to push your model onto the GPU again.