Hi all,
I have recently been testing various workflows for optimising inference in production. The non-deprecated workflows that I have found are TF-TRT and conversion to .onnx.
When attempting to convert a Tensorflow 2.6 SavedModel format model using the guidelines published here: Accelerating Inference In TF-TRT User Guide :: NVIDIA Deep Learning Frameworks Documentation 3
I get the following error:
Could not load dynamic library ‘libnvinfer.so.7’
I have a recent version of Cuda (11.4) with up to date Cudnn and TensorRT (v8). The module libnvinfer is installed but at version 8. Does this error indicate that the conversion command trt.TrtGraphConverterV2() only supports tensorRT version8?
Thanks for any help you can provide.