When will the quantitative version be released?
https://huggingface.co/npc0/chatglm3-6b-32k-int4
Uploading GGML quantized model, hope it helps
· Sign up or log in to comment
