Text Generation
GGUF
English
NEO Imatrix
Horror Imatrix
2 step Imatrix
3 step Imatrix
GGUF
128k context
instruct
all use cases
finetune
chatml
function calling
roleplaying
chat
creative
general usage
problem solving
brainstorming
solve riddles
fiction writing
plot generation
sub-plot generation
story generation
scene continue
storytelling
fiction story
story
writing
fiction
swearing
horror
conversational
Update README.md
Browse files
README.md
CHANGED
|
@@ -58,7 +58,7 @@ methods applied including 2 and 3 step passes to "micro tune" the model.
|
|
| 58 |
|
| 59 |
These multi-step passes increase the changes in the model at many levels.
|
| 60 |
|
| 61 |
-
5 examples provided below with prompts at IQ4XS (
|
| 62 |
|
| 63 |
Context: 128k.
|
| 64 |
|
|
|
|
| 58 |
|
| 59 |
These multi-step passes increase the changes in the model at many levels.
|
| 60 |
|
| 61 |
+
5 examples provided below with prompts at IQ4XS (80 t/s on mid level card).
|
| 62 |
|
| 63 |
Context: 128k.
|
| 64 |
|