Here is a workflow for multiple models on TorchServe.
  
      

      github.com
  

  
    serve/examples/Workflows at master · pytorch/serve 1

  master/examples/Workflows

  Model Serving on PyTorch. Contribute to pytorch/serve development by creating an account on GitHub.