This might be related to this issue 9.
I’m not sure, if there is a better way (torchvision-nightly?), but it seems if you would like to use the PyTorch nightly binaries, you should build torchvision from source (or use a stable PyTorch binary).