@Koramajin I am unable to reproduce the issue
TORCH : 1.10.1
CUDATOOLKIT : 11
tensor([[ 0.1940,  2.1614, -0.1721],
        [ 0.8491, -1.9244,  0.6530],
        [-0.6494, -0.8175,  0.5280]], device='cuda:0')
tensor([[ 0.0000,  0.0000,  0.0000],
        [ 0.1940,  2.1614, -0.1721]], device='cuda:0')