ggml-org
/

Voxtral-Mini-3B-2507-GGUF

Model card Files Files and versions

No model card

Downloads last month: 686

GGUF

Model size

4.01B params

Architecture

llama

Hardware compatibility

Log In to view the estimation

4-bit

Inference Providers NEW

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Collection including ggml-org/Voxtral-Mini-3B-2507-GGUF

Multimodal GGUFs

Vision and audio models compatible with llama-server and llama-mtmd-cli • 12 items • Updated 5 days ago • 6