NCCL related build ouputs:
Building wheel torch-1.0.0a0
~/Desktop/pytorch-scripts-1.0rc1/pytorch/third_party/build/nccl ~/Desktop/pytorch-scripts-1.0rc1/pytorch/third_party ~/Desktop/pytorch-scripts-1.0rc1/pytorch/build
– Set NVCC_GENCODE for building NCCL: -gencode=arch=compute_30,code=sm_30;-gencode=arch=compute_35,code=sm_35;-gencode=arch=compute_50,code=sm_50;-gencode=arch=compute_52,code=sm_52;-gencode=arch=compute_60,code=sm_60;-gencode=arch=compute_61,code=sm_61;-gencode=arch=compute_70,code=sm_70;-gencode=arch=compute_70,code=compute_70
– Build files have been written to: /home/simon/Desktop/pytorch-scripts-1.0rc1/pytorch/third_party/build/nccl
Scanning dependencies of target nccl
[100%] Generating lib/libnccl.so
Grabbing  src/nccl.h                          > /home/simon/Desktop/pytorch-scripts-1.0rc1/pytorch/third_party/build/nccl/include/nccl.h
Compiling src/libwrap.cu                      > /home/simon/Desktop/pytorch-scripts-1.0rc1/pytorch/third_party/build/nccl/obj/libwrap.o
Compiling src/core.cu                         > /home/simon/Desktop/pytorch-scripts-1.0rc1/pytorch/third_party/build/nccl/obj/core.o
Compiling src/all_gather.cu                   > /home/simon/Desktop/pytorch-scripts-1.0rc1/pytorch/third_party/build/nccl/obj/all_gather.o
Compiling src/all_reduce.cu                   > /home/simon/Desktop/pytorch-scripts-1.0rc1/pytorch/third_party/build/nccl/obj/all_reduce.o
Compiling src/broadcast.cu                    > /home/simon/Desktop/pytorch-scripts-1.0rc1/pytorch/third_party/build/nccl/obj/broadcast.o
Compiling src/reduce.cu                       > /home/simon/Desktop/pytorch-scripts-1.0rc1/pytorch/third_party/build/nccl/obj/reduce.o
Compiling src/reduce_scatter.cu               > /home/simon/Desktop/pytorch-scripts-1.0rc1/pytorch/third_party/build/nccl/obj/reduce_scatter.o
Linking   libnccl.so.1.3.5                    > /home/simon/Desktop/pytorch-scripts-1.0rc1/pytorch/third_party/build/nccl/lib/libnccl.so.1.3.5
Archiving libnccl_static.a                    > /home/simon/Desktop/pytorch-scripts-1.0rc1/pytorch/third_party/build/nccl/lib/libnccl_static.a
[100%] Built target nccl
– Installing: /home/simon/Desktop/pytorch-scripts-1.0rc1/pytorch/torch/lib/tmp_install/include/nccl.h
– Found NCCL: /home/simon/Desktop/pytorch-scripts-1.0rc1/pytorch/torch/lib/tmp_install/include
– Determining NCCL version from the header file: /home/simon/Desktop/pytorch-scripts-1.0rc1/pytorch/torch/lib/tmp_install/include/nccl.h
– Found NCCL (include: /home/simon/Desktop/pytorch-scripts-1.0rc1/pytorch/torch/lib/tmp_install/include, library: /home/simon/Desktop/pytorch-scripts-1.0rc1/pytorch/torch/lib/tmp_install/lib/libnccl.so)
– Determining NCCL version from the header file: /home/simon/Desktop/pytorch-scripts-1.0rc1/pytorch/torch/lib/tmp_install/include/nccl.h
– Found NCCL (include: /home/simon/Desktop/pytorch-scripts-1.0rc1/pytorch/torch/lib/tmp_install/include, library: /home/simon/Desktop/pytorch-scripts-1.0rc1/pytorch/torch/lib/tmp_install/lib/libnccl.so)
[ 10%] Building NVCC (Device) object third_party/gloo/gloo/CMakeFiles/gloo_cuda.dir/nccl/gloo_cuda_generated_nccl.cu.o
[ 79%] Building CXX object caffe2/CMakeFiles/caffe2_gpu.dir/contrib/nccl/cuda_nccl_gpu.cc.o
[ 79%] Building CXX object caffe2/CMakeFiles/caffe2_gpu.dir/contrib/nccl/cuda_nccl_op_gpu.cc.o
– Installing: /home/simon/Desktop/pytorch-scripts-1.0rc1/pytorch/torch/lib/tmp_install/include/caffe2/contrib/nccl
– Installing: /home/simon/Desktop/pytorch-scripts-1.0rc1/pytorch/torch/lib/tmp_install/include/caffe2/contrib/nccl/cuda_nccl_gpu.h
– Installing: /home/simon/Desktop/pytorch-scripts-1.0rc1/pytorch/torch/lib/tmp_install/lib/python3.6/site-packages/caffe2/contrib/nccl
– Installing: /home/simon/Desktop/pytorch-scripts-1.0rc1/pytorch/torch/lib/tmp_install/lib/python3.6/site-packages/caffe2/contrib/nccl/init.py
– Installing: /home/simon/Desktop/pytorch-scripts-1.0rc1/pytorch/torch/lib/tmp_install/lib/python3.6/site-packages/caffe2/contrib/nccl/nccl_ops_test.py
– Installing: /home/simon/Desktop/pytorch-scripts-1.0rc1/pytorch/torch/lib/tmp_install/lib/python3.6/site-packages/caffe2/contrib/nccl/CMakeFiles
– Installing: /home/simon/Desktop/pytorch-scripts-1.0rc1/pytorch/torch/lib/tmp_install/lib/python3.6/site-packages/caffe2/CMakeFiles/caffe2_gpu.dir/contrib/nccl
– Installing: /home/simon/Desktop/pytorch-scripts-1.0rc1/pytorch/torch/lib/tmp_install/include/torch/csrc/cuda/python_nccl.h
– Installing: /home/simon/Desktop/pytorch-scripts-1.0rc1/pytorch/torch/lib/tmp_install/include/torch/csrc/cuda/nccl.h
– Installing: /home/simon/Desktop/pytorch-scripts-1.0rc1/pytorch/torch/lib/tmp_install/include/gloo/cuda_collectives_nccl.h
– Found NCCL: /home/simon/Desktop/pytorch-scripts-1.0rc1/pytorch/torch/lib/tmp_install/include
– Determining NCCL version from the header file: /home/simon/Desktop/pytorch-scripts-1.0rc1/pytorch/torch/lib/tmp_install/include/nccl.h
– Found NCCL (include: /home/simon/Desktop/pytorch-scripts-1.0rc1/pytorch/torch/lib/tmp_install/include, library: /home/simon/Desktop/pytorch-scripts-1.0rc1/pytorch/torch/lib/tmp_install/lib/libnccl.so)
– NCCL_LIBRARIES: /home/simon/Desktop/pytorch-scripts-1.0rc1/pytorch/torch/lib/tmp_install/lib/libnccl.so
– NCCL_INCLUDE_DIRS: /home/simon/Desktop/pytorch-scripts-1.0rc1/pytorch/torch/lib/tmp_install/include
– Found NCCL, but the NCCL version is either not 2+ or not determinable, will not compile with NCCL distributed backend
– Found NCCL: /home/simon/Desktop/pytorch-scripts-1.0rc1/pytorch/torch/lib/tmp_install/include
– Determining NCCL version from the header file: /home/simon/Desktop/pytorch-scripts-1.0rc1/pytorch/torch/lib/tmp_install/include/nccl.h
– Found NCCL (include: /home/simon/Desktop/pytorch-scripts-1.0rc1/pytorch/torch/lib/tmp_install/include, library: /home/simon/Desktop/pytorch-scripts-1.0rc1/pytorch/torch/lib/tmp_install/lib/libnccl.so)
– NCCL_LIBRARIES: /home/simon/Desktop/pytorch-scripts-1.0rc1/pytorch/torch/lib/tmp_install/lib/libnccl.so
– Found NCCL, but the NCCL version is either not 2+ or not determinable, will not compile with NCCL distributed backend