It’s horrible! I test for long times. Cuda version, nvidia driver version, packages… but nothing works. 
At the very beginning, I haven’t noticed this. I just thought my modified model didn’t perform well. Then I trained the baseline model on the server and it’s really too far from the baseline performance. After that, I checked the training logs and found that all modified models trained on this server don’t have good performance.
Now I know it’s the problem caused by the environment:rofl: