What are you using the PyTorch C++ API for?
Training & Inference for image analysis (semantic segmentation at the moment) in a large C++ application.
How does your software stack look like? And how does the PyTorch C++ API interact with other components in your stack?
Windows/VS2017. A plugin in our software links libtorch. This has caused some problems with thread local variables.
Are you using JIT (TorchScript) models or  torch::nn  models?
Just torch::nn, no JIT.
Are you training models in C++?
Yes. We switched from CNTK after the development was discontinued. Unfortunately, there are not a lot of options for training from C++.
How do you think the PyTorch C++ API (or the ecosystem in general) should be improved?
-Saving/loading ONNX would be great (we have developed custom code for that).
-Fix warnings in VS2017 conformance mode.
-Compiling from source takes much longer than CNTK, DLLs are huge.
-Fix memory leaks/clean shutdown (e.g. C10_DEFINE_TYPED_REGISTRY in pytorch/blob/master/c10/util/Registry.h).