phi-2 quantized using imatrix data from kalomaze's groups_merged.txt
Perplexities: Q8_0: 5.3886 Q4_0: 5.5526 IQ3_XXS: 6.0745 IQ2_XS: 7.2570 IQ2_XXS: 9.3666 IQ1_S: 18.7885
phi-2 quantized using imatrix data from kalomaze's groups_merged.txt
Perplexities: Q8_0: 5.3886 Q4_0: 5.5526 IQ3_XXS: 6.0745 IQ2_XS: 7.2570 IQ2_XXS: 9.3666 IQ1_S: 18.7885