Hugging Face's logo

MaziyarPanahi
/
DeepSeek-V3-0324-GGUF

Text Generation
GGUF
quantized
2-bit
GGUF
imatrix
conversational
Model card Files Community
3

Any plan for IQS_XS or IQS_XXS ?

#3
by bobchenyx - opened
Discussion
bobchenyx

Hi there, thanks for all the great quantization versions! They are wonderfu.

I would like to inquire if there are any future plans for IQS_XS or IQS_XXS ? (a version smaller than 128G or perhaps around 100G?)

bobchenyx changed discussion status to closed
MaziyarPanahi
 Owner

Hi @bobchenyx
You are welcome. I do have the IQ1_S, I need to look to see how to do the IQS_XXS.

Your need to confirm your account before you can post a new comment.

Sign up or log in to comment