I can’t seem to reproduce this on my end with
import torch
import subprocess

linearcuda = torch.nn.Linear(1,1,bias=False,device='cuda')
linearcpu = torch.nn.Linear(1,1,bias=False)
onescuda = torch.ones(3,1,device='cuda')
onescpu = torch.ones(3,1)
print(linearcuda(onescuda))
print(linearcpu(onescpu))

tensor([[-0.6604],
        [-0.6604],
        [-0.6604]], device='cuda:0', grad_fn=<MmBackward>)
tensor([[-0.6166],
        [-0.6166],
        [-0.6166]], grad_fn=<MmBackward>)

Can you give some more details about this setup e.g.,
print(torch.__version__)
print(torch.version.cuda)