hugging-quants/Llama-3.2-3B-Instruct-Q8_0-GGUF
Text Generation
•
3B
•
Updated
•
7.65k
•
50
Llama 3.2 3B & 1B GGUF Quants
Llama.cpp compatible quants for Llama 3.2 3B and 1B Instruct models.
-
-
hugging-quants/Llama-3.2-3B-Instruct-Q4_K_M-GGUF
Text Generation • 3B • Updated • 3.14k • 20 -
hugging-quants/Llama-3.2-1B-Instruct-Q8_0-GGUF
Text Generation • 1B • Updated • 24.2k • 33 -
hugging-quants/Llama-3.2-1B-Instruct-Q4_K_M-GGUF
Text Generation • 1B • Updated • 48.6k • 16