The error points to a PermissionError and I’m unsure, what might cause it.
However, if you building the extension with CUDA extensions, you should update your local CUDA installation to match the CUDA shipped in the PyTorch binaries.
Note, that apparently CUDA10.1 binaries 28 for Detectron2 are available.