AWQ Quants
Collection
Quants by FrenzyBiscuit & Artus
•
22 items
•
Updated
•
1
The Omega Directive M 12B Unslop v2.0
Released by ReadyArt
Quant by FrenzyBiscuit
AWQ Details
- Model was quantized down to INT4 using GEMM Kernels.
- Zero point quantization
- Group size of 64
- Downloads last month
- 12
Inference Providers
NEW
This model isn't deployed by any Inference Provider.
🙋
Ask for provider support
Model tree for ReadyArt/The-Omega-Directive-M-12B-Unslop-v2.0-AWQ
Base model
mistralai/Mistral-Nemo-Base-2407
Finetuned
mistralai/Mistral-Nemo-Instruct-2407