Agree, for folks where perf isn’t absolutely critical (which is a lot!), Flask is a great and easy option.
The Amazon guys are putting forth an RFC for a high performance Cpp PyTorch serving platform. Would be great to get your thoughts on the RFC:

  
      github.com/pytorch/pytorch
  
  
    
  
	  
  

  
    
      [FR][RFC] Build a serving framework to host and serve trained PyTorch models 53
    

    
      
        opened 
        
          
        
        Oct 9, 2019
      
      


      
        
          
          vdantu
        
      
    
  



  🚀 Feature
Request to build a Serving framework to host and serve trained PyTorch models.
@alexwong
Motivation
PyTorch provides an excellent and easy-to-use interface to...



    feature
    triaged


  
  
    
    
  
  


Cheers!