Solved by maltequast in post #4 
              
              
                Haven’t used tflite, but I know since pytorch 1.3 you can use pytorch on mobile devices / arm architectures for experimental usage. 
In Pytorch 1.5 you can use dynamic quanization for better latency. 
Here is the tutorial. 
Also huge advantage of detr object detector is the model size. Check it out h…