How to deploy it as a service and use APIs to call it.
#5
by
gnine
- opened
How to deploy the model as a service for API calls?
This model is built-in in Xinference: https://github.com/xorbitsai/inference
Xinference provides openai compatible API.