Have you tried if it works with the tf.function and model signature approach:
  
      

      Medium – 3 May 21
  

  
    

Use pre-trained Huggingface models in TensorFlow Serving 1

  HuggingFace simplifies NLP to the point that with a few lines of code you have a complete pipeline capable to perform tasks from sentiment analysis to text generation. Being a Hub for pre-trained…

  
    Reading time: 5 min read