You have so many coder models released. What do you recomend somoene with 6BG VRAM use?
#1
by
dadadies
- opened
I use ROO Code, and have been testing Qwen3 (the smaller versions under 8b with my own VSC extension) )and now I want to try the coder variants (official and unofficial) with ROO code and my extension. Considering that this variant uses Nvidia data I assume it might be a good choice what do you think?
dadadies
changed discussion title from
You have so many coder models released. What do you recomend wsomoene with 6BG VRAM use?
to You have so many coder models released. What do you recomend somoene with 6BG VRAM use?
Try the 6B models, and Zero coder (0.8B) ;
Specifically Jan, Polaris, and Esper3 :
https://huggingface.co/DavidAU/models?search=6b
ZERO:
https://huggingface.co/DavidAU/models?search=zero
Links to GGUFs at each repo ; with "Zero" having specialized NEO Repos.
IF you want to run low quants / part on CPU ram ; NEXTCODERs are very strong (11B/12B):
https://huggingface.co/DavidAU/models?search=next
Thanks ;