Two things you could try:

Build from source (pytorch in github 67)
Install from here : pip install https://files.pythonhosted.org/packages/ca/0d/f00b2885711e08bd71242ebe7b96561e6f6d01fdb4b9dcf4d37e2e13c5e1/torchvision-0.2.1-py2.py3-none-any.whl.
This will install pytorch 0.4.1 also.