How to use?
Hi, I don't know why the model will always write more than 10 paragraphs after thinking, and always act for both {{char}} and {{user}}. I'm loading the Q5_K_M version provided by mradermacher in koboldcpp and using it in text completion mode in SillyTavern.
If I check "include names" it won't think. If I don't check it, the model is lost and will forget who it is supposed to act as. The model writes so much that I suspect it doesn't know how mistral's template works and that it should add a at the end. I don't even know if my mistral v7 tekken is correct, I couldn't find an official config for sillytavern.
Set up your config to insert [think] and [/think]. They are special tokens for thinking.
Actually it’s <think> and </think>
Yes, I do it already. But my problem is still there. The model will think, then write 10 paragraphs of both {{user}} and {{char}}. It doesn't know how to write a single paragrah nor how to act as {{char}} only.
First time I've heard this. Why don't you join the BeaverAI discord server? Plenty of folks there are happy to help
First time I've heard this. Why don't you join the BeaverAI discord server? Plenty of folks there are happy to help
Speaking of the BeaverAI Discord server, I've been trying to join with the invite link https://discord.com/invite/BeaverAI, but when I click on the Accept Invite button it just ends up reloading the invite page and says "Whoops... Unable to accept invite" without giving me a reason why.
Could be because the server is age restricted?