Prompt template for multi-turn conversations?

#15
by apepkuss79 - opened

According to the description in Model card, the prompt template is

<|prompter|>{user_message}</s><|assistant|>

How about the prompt template for multi-turn conversations? Just concatenate the prompt templates one by one? looks like the example below?

<|prompter|>{user_message_1}</s><|assistant|>{assistant_message_1}<|prompter|>{user_message_2}</s><|assistant|>
Amazon Web Services org

Yes @apepkuss79 , you can try that, but the fine tuned data didn't have such multiple run conversation. So there is no guarantee it would be able to pick the message history.

You can try to use this https://python.langchain.com/docs/modules/memory/ to manage the conversation history here. Thank you!

Sign up or log in to comment