I don’t know when Pytorch Mobile will support GPU execution. I looking forward to it 
Meanwhile, I run on CPU. I follow this recipe 24 to squeeze the maximum performance as possible. I found it that Pytorch is faster than TF Lite and as fast as TF  Lite when using XNNPACK experimental backend.