Muse-12B
Quantized GGUF weights of the Muse-12B model.
When in doubt which specific file to download, take 80% of VRAM capacity as a guideline, leaving the remaining 20% for context.
- Downloads last month
- 3,771
Hardware compatibility
Log In
to view the estimation
1-bit
2-bit
3-bit
4-bit
5-bit
6-bit
8-bit
16-bit
Inference Providers
NEW
This model isn't deployed by any Inference Provider.
🙋
Ask for provider support
Model tree for LatitudeGames/Muse-12B-GGUF
Base model
mistralai/Mistral-Nemo-Base-2407
Finetuned
LatitudeGames/Muse-12B