You could script our models and load the scripted models in libtorch (the C++ frontend) for your inference part. Just to make sure your workload is exportable, you could try to script a few similar models, to the ones you are using with your team, and perform the inference in C++.
To use TensorRT, you would have to go through ONNX. This blog post 8 might give you some ideas about the current workflow.