ewe666 commited on
Commit
82ab8a8
·
verified ·
1 Parent(s): bf4eb61

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +20 -25
README.md CHANGED
@@ -1,38 +1,33 @@
1
- ---
2
- pipeline_tag: text-generation
3
- ---
4
-
5
  Good story telling models that can fit in an RTX 3060 12GB. Updated July 2025.
6
 
7
- Some notes on best usage:
8
- - dont underestimate the original instruct models, esp from mistral
9
- - dont waste time on sampler settings; use recommended and optimize the prompt
10
- - don't "overparameterize" by writing too long a prompt
11
- - model size/intelligence is important but they are just mimics, the dataset is very important
12
-
13
- # model ranking
14
 
15
- - **Winner**: [mistralai/Mistral-Small-3.1-24B-Instruct-2503](https://huggingface.co/mistralai/Mistral-Small-3.1-24B-Instruct-2503)
16
- - [Sao10K/MN-12B-Lyra-v4](https://huggingface.co/Sao10K/MN-12B-Lyra-v4)
17
- - [MarinaraSpaghetti/NemoMix-Unleashed-12B](https://huggingface.co/MarinaraSpaghetti/NemoMix-Unleashed-12B)
18
- - [Sao10K/Fimbulvetr-11B-v2](https://huggingface.co/Sao10K/Fimbulvetr-11B-v2)
19
- - [Sao10K/L3-8B-Stheno-v3.2](https://huggingface.co/Sao10K/L3-8B-Stheno-v3.2)
20
- - [Mistral-Nemo-Instruct-2407](https://huggingface.co/mistralai/Mistral-Nemo-Instruct-2407) (12B)
 
21
  - [PocketDoc/Dans-PersonalityEngine-V1.2.0-24b](https://huggingface.co/PocketDoc/Dans-PersonalityEngine-V1.2.0-24b)
22
 
23
- # blacklist
24
- for spammers, degens, and knownothings
25
- - David AU
26
- - Sicarius
27
 
28
- # grey list
29
- - The drummer
 
30
 
31
- # misc links
 
 
 
 
 
32
 
 
33
  - [llama.cpp](https://github.com/ggerganov/llama.cpp) and [llama-cpp-python](https://github.com/abetlen/llama-cpp-python) - **preferred LLM software**
34
  - [/r/localllama](https://www.reddit.com/r/LocalLLaMA/)
35
- - [/lmg/](https://boards.4chan.org/search#/lmg/g)
36
  - [LMSys Chatbot Arena Leaderboard](https://huggingface.co/spaces/lmsys/chatbot-arena-leaderboard)
37
  - [Uncensored General Intelligence Leaderboard](https://huggingface.co/spaces/DontPlanToEnd/UGI-Leaderboard)
38
  - [/r/SillyTavernAI](https://www.reddit.com/r/SillyTavernAI/)
 
 
 
 
 
1
  Good story telling models that can fit in an RTX 3060 12GB. Updated July 2025.
2
 
3
+ # Models
 
 
 
 
 
 
4
 
5
+ - **Current favorite**: [nbeerbower/Lyra4-Gutenberg-12B](https://huggingface.co/nbeerbower/Lyra4-Gutenberg-12B)
6
+ - [Sao10K/MN-12B-Lyra-v4](https://huggingface.co/Sao10K/MN-12B-Lyra-v4)
7
+ - [mistralai/Mistral-Small-3.1-24B-Instruct-2503](https://huggingface.co/mistralai/Mistral-Small-3.1-24B-Instruct-2503)
8
+ - [MarinaraSpaghetti/NemoMix-Unleashed-12B](https://huggingface.co/MarinaraSpaghetti/NemoMix-Unleashed-12B)
9
+ - [Sao10K/Fimbulvetr-11B-v2](https://huggingface.co/Sao10K/Fimbulvetr-11B-v2)
10
+ - [Sao10K/L3-8B-Stheno-v3.2](https://huggingface.co/Sao10K/L3-8B-Stheno-v3.2)
11
+ - [Mistral-Nemo-Instruct-2407](https://huggingface.co/mistralai/Mistral-Nemo-Instruct-2407) (12B)
12
  - [PocketDoc/Dans-PersonalityEngine-V1.2.0-24b](https://huggingface.co/PocketDoc/Dans-PersonalityEngine-V1.2.0-24b)
13
 
14
+ # Creators
 
 
 
15
 
16
+ - Whitelist: Sao, nbeerbower
17
+ - Blacklist: DavidAU, SicariusSicariiStuff
18
+ - Greylst: The Drummer
19
 
20
+ # Remarks
21
+ - Roleplay and storywriting are distinct tasks! Some models excel at one and fail at the other.
22
+ - Dont waste time on sampler settings; use recommended and optimize the prompt
23
+ - Don't "overparameterize" by writing too long a prompt
24
+ - Don't underestimate the original instruct models, esp. from mistral
25
+ - Don't underestimate classical procedural generation!
26
 
27
+ # Links
28
  - [llama.cpp](https://github.com/ggerganov/llama.cpp) and [llama-cpp-python](https://github.com/abetlen/llama-cpp-python) - **preferred LLM software**
29
  - [/r/localllama](https://www.reddit.com/r/LocalLLaMA/)
30
+ - /lmg/
31
  - [LMSys Chatbot Arena Leaderboard](https://huggingface.co/spaces/lmsys/chatbot-arena-leaderboard)
32
  - [Uncensored General Intelligence Leaderboard](https://huggingface.co/spaces/DontPlanToEnd/UGI-Leaderboard)
33
  - [/r/SillyTavernAI](https://www.reddit.com/r/SillyTavernAI/)