Update: Pytorch is supported on windows now.  The peterjc123 binaries are obsolete.
Although I was not able to get the conda to install. I had to do the following with pip (as per https://pytorch.org/ 11, windows, pip, 3.6, cuda 9)
pip3 install http://download.pytorch.org/whl/cu90/torch-0.4.1-cp36-cp36m-win_amd64.whl 8
pip3 install torchvision
This worked on a plain python 3.6 install