Chat template needs fixed

by allenc87 - opened 21 days ago

21 days ago

The current chat template only allow works for the first interaction and any follow-on interaction gets an error:
[serving_chat.py:198] TypeError: can only concatenate str (not "list") to str

Please update the chat template to use this fixed one: https://huggingface.co/nm-testing/Mistral-Small-3.1-24B-Instruct-2503-FP8-dynamic/blob/main/chat_template.json

S1M0N38

2 days ago

The current chat template only allow works for the first interaction and any follow-on interaction gets an error:
[serving_chat.py:198] TypeError: can only concatenate str (not "list") to str

Please update the chat template to use this fixed one: https://huggingface.co/nm-testing/Mistral-Small-3.1-24B-Instruct-2503-FP8-dynamic/blob/main/chat_template.json

Same issue in unsloth/Mistral-Small-3.1-24B-Instruct-2503-unsloth-bnb-4bit

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

Your need to confirm your account before you can post a new comment.

· Sign up or log in to comment