I put the wrong line in this thread, as I just scraped it off the install page without clicking the correct one.
I had actually installed only one pytorch on this box, and it is the correct one.  This is does not appear to be a multiple install issue, or legacy install issue.  This is a fresh box just built.  Can anyone verify that this works on a Titan V or V100 with pytorch?
pip3 install http://download.pytorch.org/whl/cu91/torch-0.4.0-cp36-cp36m-linux_x86_64.whl

Requirement already satisfied: torch==0.4.0 from http://download.pytorch.org/whl/cu91/torch-0.4.0-cp36-cp36m-linux_x86_64.whl in ./.local/lib/python3.6/site-packages (0.4.0)


torch              0.4.0
torchvision        0.2.1

-rwxrwxr-x  1 preachermanx preachermanx 329281896 May  1 14:51 _C.cpython-36m-x86_64-linux-gnu.so