I also tried to build on WIndows:
  Stringify NVFUSER runtime source file
  Building Custom Rule C:/pytorch/caffe2/CMakeLists.txt
  Stringify NVFUSER runtime source file
  Building Custom Rule C:/pytorch/caffe2/CMakeLists.txt
  Building NVCC (Device) object caffe2/CMakeFiles/torch_cuda.dir/__/aten/src/THC/Release/torch_cuda_generated_THCReduce
  ApplyUtils.cu.obj
  nvcc fatal   : Unsupported gpu architecture 'compute_30'
  CMake Error at torch_cuda_generated_THCReduceApplyUtils.cu.obj.Release.cmake:221 (message):
    Error generating
    C:/pytorch/build/caffe2/CMakeFiles/torch_cuda.dir/__/aten/src/THC/Release/torch_cuda_generated_THCReduceApplyUtils.
  cu.obj

compute_30, but I have set TORCH_CUDA_ARCH_LIST=3.0 … seems like another variable should be set for caffe2