NCCL shouldn’t be used for a single GPU run and since you installed the binaries (as it seems based on the version number) the system NCCL, CUDA, cudnn won’t be used.
Could you update to 1.6.0 and rerun the code? Also, is the repository public, so that we could try to rerun it on a P100 machine?