Solved by Linbin in post #2 
              
              
                You need to use different C++ APIs for pytorch lite. For example, use torch::jit::mobile::Module instead of torch::jit::Module. Use torch::jit::_load_for_mobile to load a lite model.