Hugging Face's logo

ReadyArt
/
MN-2407-DSK-QwQify-v0.1-12B_EXL2_4.0bpw_H8

Text Generation
Transformers
Safetensors
mistral
conversational
text-generation-inference
4-bit precision
exl2
Model card Files Community

EXL2 Quants by FrenzyBiscuit.

This model is 4.0 BPW EXL2.

Downloads last month
2
Inference Providers NEW
Text Generation
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for ReadyArt/MN-2407-DSK-QwQify-v0.1-12B_EXL2_4.0bpw_H8

Base model

mistralai/Mistral-Nemo-Base-2407
Finetuned
PocketDoc/Dans-PersonalityEngine-V1.1.0-12b
Finetuned
PocketDoc/Dans-SakuraKaze-V1.0.0-12b
Finetuned
BeaverAI/MN-2407-DSK-QwQify-v0.1-12B
Quantized
(6)
this model

Collection including ReadyArt/MN-2407-DSK-QwQify-v0.1-12B_EXL2_4.0bpw_H8