Hugging Face's logo

ggml-org
/
Kimi-VL-A3B-Thinking-2506-GGUF

GGUF
conversational
Model card Files
xet
Community
1

Original model: https://huggingface.co/moonshotai/Kimi-VL-A3B-Thinking-2506

Supported added in this PR: https://github.com/ggml-org/llama.cpp/pull/15458

Downloads last month
1,603
GGUF
Model size
16B params
Architecture
deepseek2
Hardware compatibility
Log In to view the estimation

4-bit

8-bit

16-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for ggml-org/Kimi-VL-A3B-Thinking-2506-GGUF

Base model

moonshotai/Moonlight-16B-A3B
Finetuned
moonshotai/Kimi-VL-A3B-Instruct
Finetuned
moonshotai/Kimi-VL-A3B-Thinking-2506
Quantized
(12)
this model

Collection including ggml-org/Kimi-VL-A3B-Thinking-2506-GGUF