PyTorch 1.10
Any recommendations about how to use a PyTorch trained model for inference? Is it best to load it up with PyTorch directly, or convert to ONNX and use ONNX-runtime [1] instead? This seems to be the required way at least if you want to TensorRT the model. I appreciate this is a very general question.<p>[1] <a href="https://github.com/microsoft/onnxruntime" rel="nofollow">https://github.com/microsoft/onnxruntime</a>