Solved by hasakii in post #2 
              
              
                CUDNN version: https://github.com/pytorch/pytorch/issues/698#issuecomment-326806780 
torch.backends.cudnn.version() 
CUDA version: Pytorch 0.4 get cuda version 
torch.version.cuda 
NCCL version: How to check if NCCL is installed correctly and can be used by PyTorch? 
torch.cuda.nccl.version()