I encounter a similar issue.
Previously, my dataset.py had this line: torch.from_numpy(data) and received RuntimeError: Input type (torch.cuda.DoubleTensor) and weight type (torch.cuda.HalfTensor) should be the same
I’ve changed it to torch.from_numpy(data).float() and the error went away.
Environment

torch==1.10.1+cu113
torchaudio==0.10.1+cu113
torchinfo==1.5.2
torchvision==0.11.2+cu113