I’d really like to see something like tf serving for PyTorch. In terms of framework, automatic request batching seems one of the most important features where I would not know how to easily get that.
Best regards
Thomas