Can you add an IQ3_XS version?
#1
by
flesler
- opened
That would be great. Thanks
Hi:
You can use :
https://huggingface.co/DavidAU/L3-Stheno-v3.2-12.2B-Instruct
With "GGUF-MY_REPO" ; with an Imatrix dataset.
You can get dataset(s) here:
https://huggingface.co/DavidAU/Qwen3-8B-96k-Context-3X-Medium-Plus/tree/main
Note the "c4" , "Group", and "rp" text files.
These can be used for Imatrix.