Only the software enviroment are same, which means the same CUDA version, cudnn version, pytorch version, numpy version and linux version. But they are training on different devices.
I am sorry that i haven’t tried it for many runs. And I have only trained the model with one specific seed, perhaps 3 runs. For each run, the 2080ti seems more “smart” to learn the alignment at a early iteration than 1080ti.