I just change

https://github.com/ZPdesu/SEAN 7 to distributed training.

And I get a weird error.
It is no error，when I use one gpu.
But, It will stop without printing errors when I use multi gpus.
It will stop after Every 13 epoches by two gpus.
What could be the cause of such a problem？
my environments:
ubuntu: 16.04
gpu：nvidia-2080ti
cuda: 10.1 / 10.2
pytorch: 1.6.0 / 1.7.0
nccl: 2.4.8 / 2.7.6
python:3.6 / 3.7