I don’t know about TensorRT, but for Caffe2, you can save the Caffe2 model in predict and init files, like shown in this tutorial 28. Then I guess you can import them in the C++ API? Haven’t tried it but that seems like the way to go…