moonshotai

/

Kimi-K2-Instruct

like 1.73k

Follow

Moonshot AI 2.2k

thanks.. are u using sglang or vllm to host? i tested the template, multistep tool call in sglang still not working

Thank you so much. We forgot to put that in chat template.

In addition, role=tool message has a tool_call_id attribute that should be encoded to the content, the format is

"<|im_system|>tool<|im_middle|>" +
"## Return of {{tool_call_id}}\n" + "{{content}}" +
"<|im_end|>"

Can you update this part?

BTW, did you decipher this template from raw tokens?

@bchenfireworks thank you very much !

Also, I would like to suggest the following updates:
(1) use {{ tool_call['function']['arguments'] | tojson}} instead, to make sure arguments are legal json.
(2) add more - in control statements to eliminate blanks, so we can get a compact string.

Thanks! Let update the template following your suggestion.

Thanks! Let update the template following your suggestion.

Since the template string it too loooooong to review, could you pls also provide us an example (chat history and the rendered string), so we can verify it locally. Thank you very much, really.