You can absolutely run on CPU architectures, and performance should still be pretty good, just might not be as good as other frameworks. You could always modify/add to the Glow CPU backend’s libjit with kernels for ops you care about that are better targeted for ARM.
I know NXP has had a lot of success targeting ARM Cortex with Glow: https://media.nxp.com/news-releases/news-release-details/industrys-first-mcu-based-implementation-glow-neural-network 2 – maybe worth posting an issue on Glow’s GH with tagging mciprian13 from NXP to see if you can find out more.