I think they mostly tried to optimize the framework for the CUDA GPUs for now. Even though I have access to many fast GPUs, I sometimes like to prototype/debug things on my laptop without a GPU, so I also needed a faster CPU compute. I did find a way to install the NNPACK properly, I just followed the steps here 40. However the current code still has unresolved build issues with it, I submitted one today on the github.