If you’re only doing inference you could also consider exporting your model via ONNX and doing inference with ONNX Runtime 3. If you’re tightly integrated with windows you might benefit from the WinRT APIs distributed as part of the OS.
You’ll probably want to do some benchmarks for your use case, but I’ve found ORT to generally have excellent performance even without tuning. PyTorch for trainig+development and ORT for deployment is a pretty good combo