HF-Quantization/Llama-3.2-1B-TORCHAO-W8A8
Updated
•
98
meta-llama/Llama-3.2-1B Quantized
Find the quantized versions of Llama-3.2-1B all in one place
-
-
HF-Quantization/Llama-3.2-1B-BNB-INT8
1B • Updated • 7 -
HF-Quantization/Llama-3.2-1B-BNB-NF4
0.8B • Updated • 26 -
HF-Quantization/Llama-3.2-1B-BNB-FP4
0.8B • Updated • 18 -
HF-Quantization/Llama-3.2-1B-BNB-NF4-BF16
0.8B • Updated • 30 -
HF-Quantization/Llama-3.2-1B-BNB-FP4-BF16
0.8B • Updated • 10 -
HF-Quantization/Llama-3.2-1B-TORCHAO-W8
Updated • 8 -
HF-Quantization/Llama-3.2-1B-TORCHAO-W4
Updated • 10 -
HF-Quantization/Llama-3.2-1B-GPTQ-INT4
0.4B • Updated • 8