Update README.md
Browse files
README.md
CHANGED
@@ -1,38 +1,33 @@
|
|
1 |
-
---
|
2 |
-
pipeline_tag: text-generation
|
3 |
-
---
|
4 |
-
|
5 |
Good story telling models that can fit in an RTX 3060 12GB. Updated July 2025.
|
6 |
|
7 |
-
|
8 |
-
- dont underestimate the original instruct models, esp from mistral
|
9 |
-
- dont waste time on sampler settings; use recommended and optimize the prompt
|
10 |
-
- don't "overparameterize" by writing too long a prompt
|
11 |
-
- model size/intelligence is important but they are just mimics, the dataset is very important
|
12 |
-
|
13 |
-
# model ranking
|
14 |
|
15 |
-
- **
|
16 |
-
-
|
17 |
-
-
|
18 |
-
-
|
19 |
-
-
|
20 |
-
-
|
|
|
21 |
- [PocketDoc/Dans-PersonalityEngine-V1.2.0-24b](https://huggingface.co/PocketDoc/Dans-PersonalityEngine-V1.2.0-24b)
|
22 |
|
23 |
-
#
|
24 |
-
for spammers, degens, and knownothings
|
25 |
-
- David AU
|
26 |
-
- Sicarius
|
27 |
|
28 |
-
|
29 |
-
-
|
|
|
30 |
|
31 |
-
#
|
|
|
|
|
|
|
|
|
|
|
32 |
|
|
|
33 |
- [llama.cpp](https://github.com/ggerganov/llama.cpp) and [llama-cpp-python](https://github.com/abetlen/llama-cpp-python) - **preferred LLM software**
|
34 |
- [/r/localllama](https://www.reddit.com/r/LocalLLaMA/)
|
35 |
-
-
|
36 |
- [LMSys Chatbot Arena Leaderboard](https://huggingface.co/spaces/lmsys/chatbot-arena-leaderboard)
|
37 |
- [Uncensored General Intelligence Leaderboard](https://huggingface.co/spaces/DontPlanToEnd/UGI-Leaderboard)
|
38 |
- [/r/SillyTavernAI](https://www.reddit.com/r/SillyTavernAI/)
|
|
|
|
|
|
|
|
|
|
|
1 |
Good story telling models that can fit in an RTX 3060 12GB. Updated July 2025.
|
2 |
|
3 |
+
# Models
|
|
|
|
|
|
|
|
|
|
|
|
|
4 |
|
5 |
+
- **Current favorite**: [nbeerbower/Lyra4-Gutenberg-12B](https://huggingface.co/nbeerbower/Lyra4-Gutenberg-12B)
|
6 |
+
- [Sao10K/MN-12B-Lyra-v4](https://huggingface.co/Sao10K/MN-12B-Lyra-v4)
|
7 |
+
- [mistralai/Mistral-Small-3.1-24B-Instruct-2503](https://huggingface.co/mistralai/Mistral-Small-3.1-24B-Instruct-2503)
|
8 |
+
- [MarinaraSpaghetti/NemoMix-Unleashed-12B](https://huggingface.co/MarinaraSpaghetti/NemoMix-Unleashed-12B)
|
9 |
+
- [Sao10K/Fimbulvetr-11B-v2](https://huggingface.co/Sao10K/Fimbulvetr-11B-v2)
|
10 |
+
- [Sao10K/L3-8B-Stheno-v3.2](https://huggingface.co/Sao10K/L3-8B-Stheno-v3.2)
|
11 |
+
- [Mistral-Nemo-Instruct-2407](https://huggingface.co/mistralai/Mistral-Nemo-Instruct-2407) (12B)
|
12 |
- [PocketDoc/Dans-PersonalityEngine-V1.2.0-24b](https://huggingface.co/PocketDoc/Dans-PersonalityEngine-V1.2.0-24b)
|
13 |
|
14 |
+
# Creators
|
|
|
|
|
|
|
15 |
|
16 |
+
- Whitelist: Sao, nbeerbower
|
17 |
+
- Blacklist: DavidAU, SicariusSicariiStuff
|
18 |
+
- Greylst: The Drummer
|
19 |
|
20 |
+
# Remarks
|
21 |
+
- Roleplay and storywriting are distinct tasks! Some models excel at one and fail at the other.
|
22 |
+
- Dont waste time on sampler settings; use recommended and optimize the prompt
|
23 |
+
- Don't "overparameterize" by writing too long a prompt
|
24 |
+
- Don't underestimate the original instruct models, esp. from mistral
|
25 |
+
- Don't underestimate classical procedural generation!
|
26 |
|
27 |
+
# Links
|
28 |
- [llama.cpp](https://github.com/ggerganov/llama.cpp) and [llama-cpp-python](https://github.com/abetlen/llama-cpp-python) - **preferred LLM software**
|
29 |
- [/r/localllama](https://www.reddit.com/r/LocalLLaMA/)
|
30 |
+
- /lmg/
|
31 |
- [LMSys Chatbot Arena Leaderboard](https://huggingface.co/spaces/lmsys/chatbot-arena-leaderboard)
|
32 |
- [Uncensored General Intelligence Leaderboard](https://huggingface.co/spaces/DontPlanToEnd/UGI-Leaderboard)
|
33 |
- [/r/SillyTavernAI](https://www.reddit.com/r/SillyTavernAI/)
|