mistralai

/

Mistral-7B-Instruct-v0.3

like 1.12k

Follow

Mistral AI_ 2,488

from transformers import pipeline
messages = [
    {"role": "system", "content": "You are a pirate chatbot who always responds in pirate speak!"},
    {"role": "user", "content": "Who are you?"},
]
chatbot = pipeline("text-generation", model="mistralai/Mistral-7B-Instruct-v0.3")
chatbot(messages)

how about using this?

Good idea, updated!

I think there is no system message on mistral 7b

FYI this example won't ever work with the files currently in the repo. If you look at tokenizer_config.json, specifically chat_template field, it will raise error on messages as specified because tokenizer expects user/assistant/user... order