qwp4w3hyb
/

Yi-1.5-9B-Chat-iMat-GGUF

Text Generation

importance matrix

Inference Endpoints

Model card Files Files and versions Community

qwp4w3hyb commited on May 13

Commit

d31d0d7

•

1 Parent(s): 05216d4

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -19,7 +19,7 @@ model-index:
 # Quant Infos
 - quants done with an importance matrix for improved quantization loss
-- ggufs & imatrix generated from bf16 for "optimal" accuracy loss (some say this is snake oil, but it can't hurt)
 - Wide coverage of different gguf quant types from Q\_8\_0 down to IQ1\_S
 - Quantized with [llama.cpp](https://github.com/ggerganov/llama.cpp) commit [dc685be46622a8fabfd57cfa804237c8f15679b8](https://github.com/ggerganov/llama.cpp/commit/dc685be46622a8fabfd57cfa804237c8f15679b8) (master as of 2024-05-12)
 - Imatrix generated with [this](https://github.com/ggerganov/llama.cpp/discussions/5263#discussioncomment-8395384) multi-purpose dataset.

 # Quant Infos
 - quants done with an importance matrix for improved quantization loss
+- ggufs & imatrix generated from bf16 for "optimal" accuracy loss
 - Wide coverage of different gguf quant types from Q\_8\_0 down to IQ1\_S
 - Quantized with [llama.cpp](https://github.com/ggerganov/llama.cpp) commit [dc685be46622a8fabfd57cfa804237c8f15679b8](https://github.com/ggerganov/llama.cpp/commit/dc685be46622a8fabfd57cfa804237c8f15679b8) (master as of 2024-05-12)
 - Imatrix generated with [this](https://github.com/ggerganov/llama.cpp/discussions/5263#discussioncomment-8395384) multi-purpose dataset.