Hugging Face's logo

Green-Sky
/
nakodanei-Blue-Orchid-2x7b-GGUF-iMatrix

GGUF
English
Not-For-All-Audiences
writing
roleplay
gguf-imatrix
Inference Endpoints
Model card Files Community
Green-Sky commited on
Commit
fee82bd
·
verified ·
1 Parent(s): 7d2ab14

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -0
README.md CHANGED
@@ -30,6 +30,7 @@ for more info on imatrix handling see https://github.com/ggerganov/llama.cpp/pul
30
  | f16(baseline) | 5.8839 +/- 0.05173 |
31
  | q8_0 | 5.8880 +/- 0.05178 |
32
  | q5_k_m | xxx |
 
33
  | q4_k_m | 5.9248 +/- 0.05216 |
34
  | q4_k_m(without-imat) | 5.9492 +/- 0.05249 |
35
  | iq3_xxs | 6.1984 +/- 0.05475 |
 
30
  | f16(baseline) | 5.8839 +/- 0.05173 |
31
  | q8_0 | 5.8880 +/- 0.05178 |
32
  | q5_k_m | xxx |
33
+ | q5_k_m(without-imat) | 5.8893 +/- 0.05174 |
34
  | q4_k_m | 5.9248 +/- 0.05216 |
35
  | q4_k_m(without-imat) | 5.9492 +/- 0.05249 |
36
  | iq3_xxs | 6.1984 +/- 0.05475 |