dd95b0e 63fdc58
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
--- tags: - gptq - quantization - 4bit - confidentialmind - text-generation - apache2.0 - mistral-small-24b --- # 🔥 Quantized Model: Arcee-Blitz_gptq_g32_4bit 🔥 The MSE based test did not work out too well; use non-MSE quant.