I still suggest to use on the server side:

  
      

      TensorFlow
  

  
    

TensorFlow Serving with Docker  |  TFX 1



  

  
    
    
  

  


An alternative to explore could be:

  
      

      TensorFlow
  

  
    

TensorFlow.js in Node