Green-Sky
/

nakodanei-Blue-Orchid-2x7b-GGUF-iMatrix

Not-For-All-Audiences

Inference Endpoints

Model card Files Files and versions Community

Green-Sky commited on Feb 15, 2024

Commit

00e994e

·

verified ·

1 Parent(s): 47e2613

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -29,7 +29,7 @@ for more info on imatrix handling see https://github.com/ggerganov/llama.cpp/pul
 |--------------------|-----|
 | f16(baseline)      | 5.8839 +/- 0.05173 |
 | q8_0               | 5.8880 +/- 0.05178 |
-| q5_k_m             | xxx |
 | q5_k_m(without-imat) | 5.8893 +/- 0.05174 |
 | q4_k_m             | 5.9248 +/- 0.05216 |
 | q4_k_m(without-imat) | 5.9492 +/- 0.05249 |

 |--------------------|-----|
 | f16(baseline)      | 5.8839 +/- 0.05173 |
 | q8_0               | 5.8880 +/- 0.05178 |
+| q5_k_m             | 5.8912 +/- 0.05177 |
 | q5_k_m(without-imat) | 5.8893 +/- 0.05174 |
 | q4_k_m             | 5.9248 +/- 0.05216 |
 | q4_k_m(without-imat) | 5.9492 +/- 0.05249 |