The problem is with compiling a CUDA extension for PyTorch similar to this tutorial Custom C++ and CUDA Extensions — PyTorch Tutorials 1.8.1+cu102 documentation 13 but not with building PyTorch itself. Hope this answers the question or maybe I did not understand what is meant by modifications in this context.