No, it shouldn’t affect the compilation, but could potentially “mask” your source build once it’s successfully built. I.e. the import torch could load the binaries instead of the source build as both packages are installed in the same environment.