It seems like the pypi hosted version of torch & torchvision aren’t windows compatible and the “getting started” section suggests installing from the custom pytorch repository, but beyond that I’m not sure what the ideal solution would be to incorporate this as part of a setup script.

Reading  this, I thought you dont know about Pytorch.org that provides 100% windows compatible pip packages which you can use!
You can find all the packages here is as well https://download.pytorch.org/whl/torch_stable.html 3