Context and Instruct Templates?
Hey, been wanting to try out the model and see if it works with SillyTavern but I didn't notice within the model page anything regarding what context or instruct template we should use or something you would recommend?
Mistral v7 or the tekken one should work fine!
I haven't had a lot of time the past couple days to clean up the readmes yet. But ill make sure to add that in.
Aight noted and thanks for getting back, and recommendations for the Text Completion presets? Temps and all?
It's on my todo list. Sorry got busy with other projects.
Honestly my presets are all over the place from testing. But I'll try to clean it up and post the exports or something.
So just a quick update.
I usually dont use any crazy parameters. Usually just Temp. Top P, Min P and Dry, which I might tweak depending on the output.
Temp:
1.1 - 1.5 (The higher the better for creativity...)
I usually play around with these, and Top and Min P usually move together for me.
Top P: 0.85-0.9 (Lower for more varied output)
Min P: 0.1 - 0.15 (Higher for more varied output)
Dry Settings: (I usually use this entirely over Rep Pen, and these can vary greatly...)
Multiplier: 1.5
Base: 1
Allowed Length: 2
If I am having repetition, or similar phrasing I will start ramping Multi and Base.