I also rerun the code and got:
tensor(-0.0106, device='cuda:1') tensor(7.5541e-05, device='cuda:1') tensor(0.0082, device='cuda:1')
tensor(-0.0106, device='cuda:0') tensor(7.5541e-05, device='cuda:0') tensor(0.0082, device='cuda:0')
tensor(-0.0106, device='cuda:0') tensor(7.5541e-05, device='cuda:0') tensor(0.0082, device='cuda:0')
tensor(4.6566e-10, device='cuda:1')
tensor(9.3132e-10, device='cuda:1')

The issue of rerunning the same line of code and getting another result seems to be really strange.
Was this setup running correctly before or is this a new system?