Darkhn M3.2-24B-Animus-V7.1 EXL2
Collection
Quant(s) by FrenzyBiscuit
•
1 item
•
Updated
M3.2-24B-Animus-V7.1-EXL2
Released by Darkhn
Quant(s) by FrenzyBiscuit
4.0 BPW H6 - Fits in 24GB VRAM with 48k FP16 context
5.0 BPW H6 - Fits in 24GB VRAM with 32k FP16 context
6.0 BPW H6 - Fits in 24GB VRAM
8.0 BPW H6 - Fits in 24GB+ VRAM
Recommended Samplers (For optimal performance):
Temp: 0.8-1.1
Min_P: 0.02
DRY Multipler: 0.8
DRY Allowed Length: 4
DRY Base: 1.75
Inference Providers
NEW
This model isn't deployed by any Inference Provider.
🙋
Ask for provider support
Model tree for ReadyArt/Darkhn-M3.2-24B-Animus-V7.1-EXL2
Base model
mistralai/Mistral-Small-3.1-24B-Base-2503
Finetuned
Darkhn/M3.2-24B-Animus-V7.1