Hey, thanks for releasing the model! When can we expect support from official vllm? I guess the current vllm support is through a fork?
The official vllm repo has approved our MR. Please use the newest vllm commit, as introduced here.
· Sign up or log in to comment
