AWQ Quants
Collection
Quants by FrenzyBiscuit & Artus
•
22 items
•
Updated
•
1
Broken Tutu 24B Unslop v2.0
Released by ReadyArt
Quant by FrenzyBiscuit
AWQ Details
- Model was quantized down to INT4 using GEMM Kernels.
- Zero point quantization
- Group size of 64
- Downloads last month
- 290
Inference Providers
NEW
This model isn't deployed by any Inference Provider.
🙋
Ask for provider support
Model tree for ReadyArt/Broken-Tutu-24B-Unslop-v2.0-AWQ
Base model
mistralai/Mistral-Small-24B-Base-2501
Finetuned
ReadyArt/Broken-Tutu-24B-Unslop-v2.0