hfl
/

chinese-mixtral-instruct-gguf

Mixture of Experts

Inference Endpoints

Model card Files Files and versions

hfl-rc commited on Jan 29

Commit

404fc42

•

1 Parent(s): 24cdd9f

Update README.md

Files changed (1) hide show

README.md +5 -5

README.md CHANGED Viewed

@@ -20,13 +20,13 @@ Metric: PPL, lower is better
 | ----- | ---- |
 | IQ2_XXS | - |
 | IQ2_XS | - |
-| Q2_K  | -    |
-| Q3_K  | -     |
 | Q4_0  | -      |
-| Q4_K  | -    |
 | Q5_0  | -     |
-| Q5_K  | -    |
-| Q6_K  | -     |
 | Q8_0  | -     |
 | F16   |   x   |

 | ----- | ---- |
 | IQ2_XXS | - |
 | IQ2_XS | - |
+| Q2_K  | 4.5758 +/- 0.03959    |
+| Q3_K  | 4.5563 +/- 0.04126     |
 | Q4_0  | -      |
+| Q4_K  | 3.9265 +/- 0.03407    |
 | Q5_0  | -     |
+| Q5_K  | 3.9232 +/- 0.03403    |
+| Q6_K  | 3.9242 +/- 0.03415     |
 | Q8_0  | -     |
 | F16   |   x   |