metadata
base_model:
- Darkhn/M3.2-24B-Animus-V7.1
base_model_relation: quantized
quantized_by: frenzybiscuit
tags:
- mistral-3.2
- finetune
- roleplay
- chat
- wings-of-fire
- dungeon-master
- EXL2
license: apache-2.0
M3.2-24B-Animus-V7.1-EXL2
Released by Darkhn
Quant(s) by FrenzyBiscuit
4.0 BPW H6 - Fits in 24GB VRAM with 48k FP16 context
5.0 BPW H6 - Fits in 24GB VRAM with 32k FP16 context
6.0 BPW H6 - Fits in 24GB VRAM
8.0 BPW H6 - Fits in 24GB+ VRAM
Recommended Samplers (For optimal performance):
Temp: 0.8-1.1
Min_P: 0.02
DRY Multipler: 0.8
DRY Allowed Length: 4
DRY Base: 1.75