File size: 234 Bytes
dd95b0e
 
 
 
 
 
 
 
 
 
 
 
 
63fdc58
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
---
tags:
- gptq
- quantization
- 4bit
- confidentialmind
- text-generation
- apache2.0
- mistral-small-24b
---
# 🔥 Quantized Model: Arcee-Blitz_gptq_g32_4bit 🔥


The MSE based test did not work out too well; use non-MSE quant.