vllm open ai api

by prudant - opened Jun 5

Jun 5

hi, can be served by open ai vllm api? if yes can you give us an usage example with open ai api client over vllm?

nice jobs
regards!

Jun 7

Same question here!

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment