Converted to MLX and quantized to Q4. Base model https://huggingface.co/meta-llama/Llama-3.2-3B-Instruct .

Downloads last month
6
Safetensors
Model size
502M params
Tensor type
F16
·
U32
·
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for jesusoctavioas/Llama-3.2-3B-Instruct-MLX-Q4

Quantized
(338)
this model