tags: - gptq - quantization - 4bit - confidentialmind - text-generation - apache2.0 - mistral-small-24b
The MSE based test did not work out too well; use non-MSE quant.
