It does support cuda 9, although I remember when I built it about a month ago it failed initially because the nccl that comes with pytorch by default did not work with cuda 9. So I found nccl2 on github, and then copied over its files to the nccl folder that comes with pytorch and was able to build it successfully.