For my best knowledge there 3 ways to do so


Run your PyTorch model on Android GPU using libMACE
Run your PyTorch model on Android GPU using libMACE | by Vitaliy Hramchenko | Medium 6
Which needs to ONNX convertation


Via Android NNAPI
PyTorch Mobile Now Supports Android NNAPI | by PyTorch | PyTorch | Medium 4
(Prototype) Convert MobileNetV2 to NNAPI — PyTorch Tutorials 1.7.1 documentation 2
Which requires special PyTorch revision?


PyTorch on Vulkan backend
tutorials/prototype_source at master · pytorch/tutorials · GitHub 6
Which allows only float32 because Vulkan itself is a Graphic engine I think.


Could you please share your thoughts, because I want to make as less effort as I possibly can. I know that all these features are prototypes but its is ok for me.