What are you using the PyTorch C++ API for?
Making a faster and more lightweight deployment binary. I also just really enjoy C++.


How does your software stack look like? And how does the PyTorch C++ API interact with other components in your stack?
We’re using C for our main product. Currently figuring out how the model with be incorporated into the main product.


Are you using JIT (TorchScript) models or torch::nn models?
JIT for now


Are you training models in C++?
Not right now but possibly in the future.


How do you think the PyTorch C++ API (or the ecosystem in general) should be improved?
I’d like it if there was a way to compile the model to a binary file so as to reduce the time it takes to be loaded/called from the file.