--- base_model: - Darkhn/M3.2-24B-Animus-V7.1 base_model_relation: quantized quantized_by: frenzybiscuit tags: - mistral-3.2 - finetune - roleplay - chat - wings-of-fire - dungeon-master - EXL2 license: apache-2.0 ---
Released by Darkhn
Quant(s) by FrenzyBiscuit
4.0 BPW H6 - Fits in 24GB VRAM with 48k FP16 context
5.0 BPW H6 - Fits in 24GB VRAM with 32k FP16 context
6.0 BPW H6 - Fits in 24GB VRAM
8.0 BPW H6 - Fits in 24GB+ VRAM
Recommended Samplers (For optimal performance):
Temp: 0.8-1.1
Min_P: 0.02
DRY Multipler: 0.8
DRY Allowed Length: 4
DRY Base: 1.75