Solved by mapes911 in post #4 
              
              
                Scratch that, I found the problem.  I had my Header Search Paths set to recursive and that caused my issues. 
For anyone that finds this… here’s what I did to get this installed on WatchOS. 

cloned the pytorch repo
cd pytorch
git checkout v1.4.0
git submodule sync
git submodule update --init --recu…