I have been looking for something like this but couldn’t find it either. Based on the blog you found blog/tf-serving.md at master · huggingface/blog · GitHub 27, the author mentioned that it’s a possible next step improvement so not sure if this is already possible.