metadata
base_model:
- anthracite-core/Mistral-Small-3.2-24B-Instruct-2506-Text-Only
library_name: transformers
tags:
- roleplay
- conversational
datasets:
- allenai/tulu-3-sft-personas-instruction-following
- nvidia/HelpSteer3
- zerofata/Roleplay-Anime-Characters
- zerofata/Instruct-Anime-CreativeWriting
This is a Mistral Small 3.2 finetune with a modified chat template which mimics the Mistral V2/V3 approach (including moving the system message into a user tagged entry at the end).
This is fine tuned for use in Silly Tavern. If you use something else you need to adapt.
Update: The latest version of Silly Tavern (staging) will support the custom position story string / role once support has been merged. All you have to do is this:
I.e. change position to In Chat at Depth 1 as User.
NO need for system prompt lore books or anything else!
Notes on usage:
- avoid being too specific in character cards, as there's a chance the model will "get stuck". E.g. if some information may change during the course of the roleplay, you want to avoid including it in the character card and potentially move it to the starting message instead.
- narrator cards may break if they use "{{char}}" incorrectly (the model will think "GameMaster" is a character if you accidentally include something like "{{char}} and {{user}} are neighbors" in the character card or in lorebook entries)
- some character cards which include example responses in the description will work better if the examples are moved into actual examples in the advanced definitions, but you may want to also enable "Always include examples" in Example Messages Behavior in the User Settings, or the examples will be lost when you hit the context limit
- this is a preview; please let me know what you think so I can polish this into something excellent