You can set the environment variable NCCL_DEBUG=INFO to make it output logs.
Also see:

https://pytorch.org/docs/stable/distributed.html#other-nccl-environment-variables 87
https://docs.nvidia.com/deeplearning/sdk/nccl-developer-guide/docs/env.html 31