Hello @royaff0,


Could you please try using our nightlies  ( https://github.com/pytorch/pytorch/tree/master/android#nightly 15 ) what will be the performance. ( Some significant performance improvements were merged recently )


You may try to use quantized pre-trained model (for example mobilenet_v2, specifying quantize=True)
https://github.com/pytorch/vision/blob/master/torchvision/models/quantization/mobilenet.py#L59 9
Are quantize accuracy and performance acceptable for your task?


Tensorflow lite has the support of mobile GPU, while PyTorch android at the moment only uses CPU, but we are working on this support at the moment.