It should be included. Could you try running
print(torch.cuda.nccl.is_available(torch.randn(1).cuda()))
print(torch.cuda.nccl.version())

and tell me the output?
@inkplay it’d be great if you can run the above lines as well!