Text Generation
GGUF
English
creative
creative writing
fiction writing
plot generation
sub-plot generation
story generation
scene continue
storytelling
fiction story
llama 3.1
llama-3
llama3
llama-3.1
science fiction
romance
all genres
story
writing
vivid prosing
vivid writing
fiction
roleplaying
bfloat16
swearing
role play
sillytavern
backyard
horror
context 128k
mergekit
Merge
6X8B
Mixture of Experts
mixture of experts
Not-For-All-Audiences
imatrix
conversational
Update README.md
Browse files
README.md
CHANGED
|
@@ -115,7 +115,7 @@ The "horror tint" will be strongest at IQ4s (1st choice) / Q4s (2nd choice) and
|
|
| 115 |
|
| 116 |
Recommend q5s/q6/q8 for general usage.
|
| 117 |
|
| 118 |
-
Note that
|
| 119 |
|
| 120 |
More information on quants is in the document below "Highest Quality Settings / Optimal Operation Guide / Parameters and Samplers".
|
| 121 |
|
|
|
|
| 115 |
|
| 116 |
Recommend q5s/q6/q8 for general usage.
|
| 117 |
|
| 118 |
+
Note that IQ2s performance is acceptable, whereas IQ3s+ are strong.
|
| 119 |
|
| 120 |
More information on quants is in the document below "Highest Quality Settings / Optimal Operation Guide / Parameters and Samplers".
|
| 121 |
|