You can remap the Tensor location at load time using the map_location argument to torch.load. For example this will forcefully remap everything onto CPU:
torch.load('my_file.pt', map_location=lambda storage, location: 'cpu')

While this will only map storages from GPU0:
torch.load('my_file.pt', map_location={'cuda:0': 'cpu'})