iamshnik:

However, I want to know what was the issue that was triggering the NCCL deadlock.


It’s unclear to me that NCCL caused the deadlock. Without a code snippet to reproduce it, I cannot be very helpful in isolating the issue.