Green-Sky
/

nakodanei-Blue-Orchid-2x7b-GGUF-iMatrix

Not-For-All-Audiences

Model card Files Files and versions Community

Green-Sky commited on Feb 15, 2024

Commit

1e64b63

·

verified ·

1 Parent(s): 0dd3b25

Update README.md

Files changed (1) hide show

README.md +1 -0

README.md CHANGED Viewed

@@ -31,6 +31,7 @@ for more info on imatrix handling see https://github.com/ggerganov/llama.cpp/pul
 | q8_0               | 5.8880 +/- 0.05178 |
 | q5_k_m             | xxx |
 | q4_k_m             | 5.9248 +/- 0.05216 |
 | iq3_xxs            | 6.1984 +/- 0.05475 |
 | iq3_xxs(only-wiki) | 6.1796 +/- 0.05446 |
 | iq3_xxs(only-kal)  | 6.1984 +/- 0.05475 |

 | q8_0               | 5.8880 +/- 0.05178 |
 | q5_k_m             | xxx |
 | q4_k_m             | 5.9248 +/- 0.05216 |
+| q4_k_m(without-imat) | 5.9492 +/- 0.05249 |
 | iq3_xxs            | 6.1984 +/- 0.05475 |
 | iq3_xxs(only-wiki) | 6.1796 +/- 0.05446 |
 | iq3_xxs(only-kal)  | 6.1984 +/- 0.05475 |