Hi,
Sorry it took a bit of time to get the machine.
I’m afraid I cannot repro with the modifies script below: I don’t have a screen on the other machine so I compare the outputs with:
print(output.min(), output.mean(), output.max())
print(output1.min(), output1.mean(), output1.max())
print(output2.min(), output2.mean(), output2.max())
print((output - output1.to("cuda:1")).abs().max())
print((output - output2.to("cuda:1")).abs().max())

And they all seems to be the same.
What does these prints return for you?