Green-Sky
/

nakodanei-Blue-Orchid-2x7b-GGUF-iMatrix

Not-For-All-Audiences

Inference Endpoints

Model card Files Files and versions Community

Green-Sky commited on Feb 14, 2024

Commit

0382cc7

·

verified ·

1 Parent(s): 71a4827

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -28,7 +28,7 @@ for more info on imatrix handling see https://github.com/ggerganov/llama.cpp/pul
 | quant              | ppl (lower is better) |
 |--------------------|-----|
 | f16(baseline)      | 5.8839 +/- 0.05173 |
-| q8_0               | xxx |
 | q5_k_m             | xxx |
 | q4_k_m             | xxx |
 | iq3_xxs            | 6.1984 +/- 0.05475 |

 | quant              | ppl (lower is better) |
 |--------------------|-----|
 | f16(baseline)      | 5.8839 +/- 0.05173 |
+| q8_0               | 5.8880 +/- 0.05178 |
 | q5_k_m             | xxx |
 | q4_k_m             | xxx |
 | iq3_xxs            | 6.1984 +/- 0.05475 |