The following code snippet reproduces the error:
>>> import torch
>>> print(torch.__version__)
1.9.0+cu102
>>> test = torch.tensor([0.5]).to('cuda:0')
>>> test
tensor([0.5000], device='cuda:0')
>>> test.to('cuda:1')
tensor([0.], device='cuda:1')

Oddly enough, this only happens on one of my machines.