Hi @dennism Try turning on verbose adb logs and checking if the ops are running on the accelerator?
https://developer.android.com/ndk/guides/neuralnetworks#nnapi_logs 3
Sounds like some part of the graph is running on the CPU which goes to the NNAPI reference implementation which might be slower than regular Pytorch code