I figured out how to get the pre-built binaries for CUDA 10.0.
sudo pip install torch==1.3.0+cu100 torchvision==0.4.1+cu100 -f https://download.pytorch.org/whl/torch_stable.html

This will work for me. Thanks for all the help.