sunshichen:

Actually I have another question about v1.1.0 DDP.


Are you referring to PyTorch v1.1.0 here? If so, I’d suggest upgrading to PyTorch 1.7 which is the latest version to see if this problem still persists.