I tested it in my Python3 environment with PyTorch 0.4.0 and  it also works.
The sys.path of this env in case you would like to see it:
['',
 '/home/ptrblck/anaconda2/envs/py3/lib/python36.zip',
 '/home/ptrblck/anaconda2/envs/py3/lib/python3.6',
 '/home/ptrblck/anaconda2/envs/py3/lib/python3.6/lib-dynload',
 '/home/ptrblck/anaconda2/envs/py3/lib/python3.6/site-packages',
 '/home/ptrblck/anaconda2/envs/py3/lib/python3.6/site-packages/torchvision-0.2.1-py3.6.egg']