add perplexities data
Browse files
README.md
CHANGED
|
@@ -1 +1,9 @@
|
|
| 1 |
-
https://huggingface.co/microsoft/phi-2 quantized using [kalomaze's groups_merged.txt
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
[phi-2](https://huggingface.co/microsoft/phi-2) quantized using imatrix data from [kalomaze's groups_merged.txt](https://github.com/ggerganov/llama.cpp/files/14194570/groups_merged.txt)
|
| 2 |
+
|
| 3 |
+
Perplexities:
|
| 4 |
+
Q8_0: 5.3886
|
| 5 |
+
Q4_0: 5.5526
|
| 6 |
+
IQ3_XXS: 6.0745
|
| 7 |
+
IQ2_XS: 7.2570
|
| 8 |
+
IQ2_XXS: 9.3666
|
| 9 |
+
IQ1_S: 18.7885
|