phi-2-imatrix-gguf / README.md
ristew's picture
add perplexities data
e832081

phi-2 quantized using imatrix data from kalomaze's groups_merged.txt

Perplexities: Q8_0: 5.3886 Q4_0: 5.5526 IQ3_XXS: 6.0745 IQ2_XS: 7.2570 IQ2_XXS: 9.3666 IQ1_S: 18.7885