metadata
base_model:
- anthracite-core/Mistral-Small-3.2-24B-Instruct-2506-Text-Only
library_name: transformers
tags:
- roleplay
- conversational
datasets:
- allenai/tulu-3-sft-personas-instruction-following
- nvidia/HelpSteer3
- zerofata/Roleplay-Anime-Characters
- zerofata/Instruct-Anime-CreativeWriting
This is a Mistral Small 3.2 finetune with a modified chat template which mimics the Mistral V2/V3 approach (including moving the system message into a user tagged entry at the end).
This is fine tuned for use in Silly Tavern. If you use something else you need to adapt.
Update: The latest version of Silly Tavern (staging as of 20250810) supports the custom position story string / role. All you have to do is this:
I.e. change position to In Chat at Depth 1 as System and set "System Same as User" under System Message Sequences. (Note: this was updated as the original approach inserted the user character name into the system prompt.)
Notes on usage:
- avoid being too specific in character cards, as there's a chance the model will "get stuck". E.g. if some information may change during the course of the roleplay, you want to avoid including it in the character card and potentially move it to the starting message instead.
- narrator cards may break if they use "{{char}}" incorrectly (the model will think "GameMaster" is a character if you accidentally include something like "{{char}} and {{user}} are neighbors" in the character card or in lorebook entries)
- some character cards which include example responses in the description will work better if the examples are moved into actual examples in the advanced definitions, but you may want to also enable "Always include examples" in Example Messages Behavior in the User Settings, or the examples will be lost when you hit the context limit
- this is a preview; please let me know what you think so I can polish this into something excellent