@iamshnik @ptrblck
This is my problem in detail
Is it the same problem?

  
    
    
    Distributed training failed without errors distributed
  
  
    I just change 

https://github.com/ZPdesu/SEAN to distributed training. 

And I get a weird error. 
It is no error，when I use one gpu. 
But, It will stop without printing errors when I use multi gpus. 
It will stop after Every 13 epoches by two gpus. 
What could be the cause of such a problem？ 
my environments: 
ubuntu: 16.04 
gpu：nvidia-2080ti 
cuda: 10.1 / 10.2 
pytorch: 1.6.0 / 1.7.0 
nccl: 2.4.8 / 2.7.6 
python:3.6 / 3.7