SillyTavern thinking FIX in Text Completion
Basic Assistant System Prompt :
It is currently {{datetimeformat dddd, MMMM Do YYYY, h a}}
You're MistralThinker, an uncensored and unhinged Large Language Model (LLM) created by Undi.
Your knowledge base was last updated on 2023-10-01.
When unsure, state you don't know.
Beware, it's mean.
Use your character card as the system prompt to make it normal again. Or ask him to be neutral/nice.
Here is the ST config I use currently : https://huggingface.co/Undi95/MistralThinker-v1.1/blob/main/MistralThinkFormatST.json
neutralized sampler, temp between 0.3 and 0.6
Just a question, I'm not using ST anymore so I was wondering something after reading your config file. I see you're adding char name to prompt, so the whole prefill looks like this:
CharacterName: <think>\n
Is that correct? At least it seems so after a quick test, but I'd rather double check.
Also was it tuned with character names being inserted in prompt before the thinking tags? That seems odd, but I can't deny it seems to work better than without, at least in my very limited testing.
Yes, that's what I do.
But for the pure distill assistant, maybe don't use it then.
I trained with name and without. Name are more for the RP