Text Generation
GGUF
English
creative
creative writing
fiction writing
plot generation
sub-plot generation
story generation
scene continue
storytelling
fiction story
science fiction
romance
all genres
story
writing
vivid prose
vivid writing
fiction
roleplaying
bfloat16
swearing
rp
llama3
enhanced quants
max quants
maxcpu quants
horror
mergekit
conversational
The L3-Dark-Planet-8B-D_AU-Q6_k.gguf is 566 MB?
#3
by
Lonmine
- opened
Everything else is above at least 1gb so i am finding it odd, is it correct?
That is the super compressed, top secret zip file one, that operates at 1000 t/s... JK.
Nope... that is a screw up.
Thank you for the catch!
I legitimately want to say that this model is the best i could find yet, i tried the darkest planet 16.5B but it didn't run well here maybe because i only have 12gb VRAM and 16gb RAM or because i use AMD, it behaved a bit like gemma writer restless quill explaining the story to me but way slower and not understanding the plot of the story. So, i just wanted to say you did a really good job on this one, i will be looking forward for further improvements