So I got it work by launching from the latest ubuntu deep learning AMI for CUDA 9, then installing torch and torchvision from source. But to run torchvision from source I had to give write permissions to anaconda’s easy installer. Then it worked. I’m not sure why i had to do this, or if thats good practice to give those permissions, but after that it worked. However, I did notice that upon calling Tensor(1).cuda() for the first time, it took about 10 seconds for that to load, and immediately ate about 700M of GPU memory, but after that everything went smooth.