I am new to python and pytorch, and I got the similar question before.
Then I took the method by:
pip3 install http://download.pytorch.org/whl/cu90/torch-0.4.0-cp36-cp36m-linux_x86_64.whl 
pip3 install torchvision

It seems work for me – V100 with pytorch.
Maybe it has already been solved.
But if I try to:
pip3 install torch torchvision

according to the website https://pytorch.org/ 26 for pytorch with cuda 9.0, * cu80/torch-0.4.0-cp36-cp36m-linux_x86_64.whl 7 will still be download, which is quite confusing.