I think there is a problem with the Conda’s Python installation command given on the homepage because it installs torch 0.1.12 (an old version I guess) instead of the last one 0.3.0.
The command I used is:
conda install pytorch torchvision -c pytorch

that proposes ton install:
pytorch:     0.1.12-py36cuda8.0cudnn6.0_1        
torchvision: 0.1.8-py36_0 

It seems that it is not normal.