Hugging Face's logo

second-state
/
Yi-1.5-9B-Chat-GGUF

Text Generation
Transformers
GGUF
llama
conversational
Model card Files Community
1
apepkuss79 commited on
Commit
300834e
·
verified ·
1 Parent(s): 698388b

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -88,4 +88,4 @@ quantized_by: Second State Inc.
88
  | [Yi-1.5-9B-Chat-Q8_0.gguf](https://huggingface.co/second-state/Yi-1.5-9B-Chat-GGUF/blob/main/Yi-1.5-9B-Chat-Q8_0.gguf) | Q8_0 | 8 | 6.44 GB| very large, extremely low quality loss - not recommended |
89
  | [Yi-1.5-9B-Chat-f16.gguf](https://huggingface.co/second-state/Yi-1.5-9B-Chat-GGUF/blob/main/Yi-1.5-9B-Chat-f16.gguf) | f16 | 16 | 17.7 GB| |
90
 
91
- *Quantized with llama.cpp b2824*
 
88
  | [Yi-1.5-9B-Chat-Q8_0.gguf](https://huggingface.co/second-state/Yi-1.5-9B-Chat-GGUF/blob/main/Yi-1.5-9B-Chat-Q8_0.gguf) | Q8_0 | 8 | 6.44 GB| very large, extremely low quality loss - not recommended |
89
  | [Yi-1.5-9B-Chat-f16.gguf](https://huggingface.co/second-state/Yi-1.5-9B-Chat-GGUF/blob/main/Yi-1.5-9B-Chat-f16.gguf) | f16 | 16 | 17.7 GB| |
90
 
91
+ *Quantized with llama.cpp b3135*