@smth @ptrblck was this issue ever solved. I am facing NCCL deadlock issues in DistributedDataParallel.
Also, I face this issue with some particular architectures only and I don’t understand what does the architecture has to do with the NCCL deadlock?