MaziyarPanahi
/

Yi-9B-GGUF

Text Generation

4-bit precision

8-bit precision

arxiv:2311.16502

arxiv:2401.11944

Inference Endpoints

text-generation-inference

Model card Files Files and versions Community

Thanks for your quants!

#3

by Cran-May - opened Mar 15

Mar 15

Would you mind making a GGUF quantization for feeltheAGI/yi-super-9B as well?
https://huggingface.co/feeltheAGI/yi-super-9B

Owner Mar 15

@Cran-May of course! Uploads will be available here: https://huggingface.co/MaziyarPanahi/yi-super-9B-GGUF

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment