Premise
I just wanted to pin this topic, so that it can be used for future reference.
Recommendations
If you are a PyTorch user, I would recommend to add soumith as source server to your Anaconda (or Miniconda)
conda config --add channels soumith

Then, to get the latest PyTorch and vision package via conda, you can simply
conda update pytorch torchvision

PyTorch will be installed in
$HOME/anaconda3/lib/python3.5/site-packages/torch

this is because you want to use Python 3 (since Python 2 is going to die soon).
Questions
If you want the latest PyTorch update, I believe you should install from source. (Am I correct? Will it be installed in the same directory, like when we were luarocks make the old Torch?)
The location of torchvision is… unknown. I couldn’t find where Anaconda put it. torchvision.__file__ says
$HOME/anaconda3/lib/python3.5/site-packages/torchvision-0.1.6-py3.5.egg/torchvision/__init__.py

but such location does not exist. Nevertheless, my IDE can find those files in that location, when exploring the source code.
Another thing I’m puzzled about is the following location a RuntimeError spits out
/data/users/soumith/miniconda2/conda-bld/pytorch-0.1.7_1485445763020/work/torch/lib/THNN/generic/SpatialConvolutionMM.c