Small but Powerful
#1
by
Llynara
- opened
I'm amazed at how small this model is, but so fast and has a huge context window. I'm running it on a 7-year old computer with an 11 GB graphic card and 64 GB RAM. Currently testing story ideas and complex fantasy world builds with it. I also threw a novella at it and discussed reworking the character backstories and arcs. It's handled most of it quite well.
Thank you for your work! I really enjoy playing with all these great local, tweaked models.
Thank you!
Can you tell me which quant(s) you used?
This repo is a test bed for multiple quants using different imatrix and different Brainstorm+ Imatrixes.
I am using: Qwen3-4B-Instruct-2507-NEO-IQ4_XS-imat.gguf