Text Generation
GGUF
English
creative
creative writing
fiction writing
plot generation
sub-plot generation
story generation
scene continue
storytelling
fiction story
science fiction
romance
all genres
story
writing
vivid prose
vivid writing
fiction
roleplaying
bfloat16
swearing
rp
llama3
llama-3
enhanced quants
max quants
maxcpu quants
horror
mergekit
conversational
The L3-Dark-Planet-8B-D_AU-Q6_k.gguf is 566 MB?
#3
by
Lonmine
- opened
Everything else is above at least 1gb so i am finding it odd, is it correct?
That is the super compressed, top secret zip file one, that operates at 1000 t/s... JK.
Nope... that is a screw up.
Thank you for the catch!
I legitimately want to say that this model is the best i could find yet, i tried the darkest planet 16.5B but it didn't run well here maybe because i only have 12gb VRAM and 16gb RAM or because i use AMD, it behaved a bit like gemma writer restless quill explaining the story to me but way slower and not understanding the plot of the story. So, i just wanted to say you did a really good job on this one, i will be looking forward for further improvements