| tags: | |
| - gptq | |
| - quantization | |
| - 4bit | |
| - confidentialmind | |
| - text-generation | |
| - apache2.0 | |
| - mistral-small-24b | |
| # 🔥 Quantized Model: Arcee-Blitz_gptq_g32_4bit 🔥 | |
| The MSE based test did not work out too well; use non-MSE quant. | |
| tags: | |
| - gptq | |
| - quantization | |
| - 4bit | |
| - confidentialmind | |
| - text-generation | |
| - apache2.0 | |
| - mistral-small-24b | |
| # 🔥 Quantized Model: Arcee-Blitz_gptq_g32_4bit 🔥 | |
| The MSE based test did not work out too well; use non-MSE quant. | |