What is the difference between the jobs? Are they using different

containers, machines, hardware
PyTorch, CUDA, cudnn versions

Note that seeding the code (and setting all other deterministic settings) should make the run deterministic on the current node (with the mentioned exceptions in the Reproducibility docs), but do not guarantee to give the same result on different hardware.