File size: 1,927 Bytes
bf4eb61 2ddb423 82ab8a8 4dd6f9b 82ab8a8 a602b52 d36ca55 82ab8a8 a602b52 82ab8a8 c7266c5 82ab8a8 985e25b 82ab8a8 90a206b ff06632 82ab8a8 3f09381 b620ede 3f09381 281390b f162dfd |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 |
Good story telling models that can fit in an RTX 3060 12GB. Updated July 2025.
# Models
- **Current favorite**: [nbeerbower/Lyra4-Gutenberg-12B](https://huggingface.co/nbeerbower/Lyra4-Gutenberg-12B)
- [Sao10K/MN-12B-Lyra-v4](https://huggingface.co/Sao10K/MN-12B-Lyra-v4)
- [mistralai/Mistral-Small-3.1-24B-Instruct-2503](https://huggingface.co/mistralai/Mistral-Small-3.1-24B-Instruct-2503)
- [MarinaraSpaghetti/NemoMix-Unleashed-12B](https://huggingface.co/MarinaraSpaghetti/NemoMix-Unleashed-12B)
- [Sao10K/Fimbulvetr-11B-v2](https://huggingface.co/Sao10K/Fimbulvetr-11B-v2)
- [Sao10K/L3-8B-Stheno-v3.2](https://huggingface.co/Sao10K/L3-8B-Stheno-v3.2)
- [Mistral-Nemo-Instruct-2407](https://huggingface.co/mistralai/Mistral-Nemo-Instruct-2407) (12B)
- [PocketDoc/Dans-PersonalityEngine-V1.2.0-24b](https://huggingface.co/PocketDoc/Dans-PersonalityEngine-V1.2.0-24b)
# Creators
- Whitelist: Sao, nbeerbower
- Blacklist: DavidAU, SicariusSicariiStuff
- Greylst: The Drummer
# Remarks
- Roleplay and storywriting are distinct tasks! Some models excel at one and fail at the other.
- Dont waste time on sampler settings; use recommended and optimize the prompt
- Don't "overparameterize" by writing too long a prompt
- Don't underestimate the original instruct models, esp. from mistral
- Don't underestimate classical procedural generation!
# Links
- [llama.cpp](https://github.com/ggerganov/llama.cpp) and [llama-cpp-python](https://github.com/abetlen/llama-cpp-python) - **preferred LLM software**
- [/r/localllama](https://www.reddit.com/r/LocalLLaMA/)
- /lmg/
- [LMSys Chatbot Arena Leaderboard](https://huggingface.co/spaces/lmsys/chatbot-arena-leaderboard)
- [Uncensored General Intelligence Leaderboard](https://huggingface.co/spaces/DontPlanToEnd/UGI-Leaderboard)
- [/r/SillyTavernAI](https://www.reddit.com/r/SillyTavernAI/)
- NothingiisReal discord
- NeverSleep discord
- SillyTavern discord
- BeaverAI discord |