Quantization
#1
by
King-Cane
- opened
Hey bro! a 3bit or 2bit quantization would be appreciated!
King-Cane
changed discussion status to
closed
Hi! For now you can create a quantizaed version by using https://huggingface.co/spaces/ggml-org/gguf-my-repo
Hi! For now you can create a quantizaed version by using https://huggingface.co/spaces/ggml-org/gguf-my-repo
bro! thankyou so much! it actually works! arigatou gozaimasu!