I am trying to run PyTorch on Android system following this document 10. And the model is working fine, however i noticed that forward() method is consuming too much time.
On my Pixel 3 it need average 300ms to run (MobileNetV2 from torchvision). I also tried SSD-MobileNetV2-Lite model (pretrained) from this 2 repo, and it cost about 700ms to run.
Same model on Tensorflow mobile seems much faster.
Can anyone tell me why and how to solve this performance issue?