Using tensorrt model.engine Inference speed is relatively fast. Why is onnxruntime based on tensorrt as slow as CPU inference
# ❓ Questions & Help
https://github.com/huggingface/transformers/blob/master/notebooks/04-onnx-export.ipynb
Based on different providers to infer the  .onnx model, why is CUDA the fastest and tensorrt based model particularly slow
Using tensorrt model.engine Inference speed is relatively fast. Why is onnxruntime based on tensorrt as slow as CPU inference

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.
