vLLM supported
#1
by
hzli163
- opened
It seems Ling-lite-1.5 do not support vLLM yet?
Sorry for the late reply. Check vLLM/SGLang supported in the following links:
vLLM: https://github.com/vllm-project/vllm/pull/20680
SGLang: https://github.com/sgl-project/sglang/pull/8680
zzqsmall
changed discussion status to
closed