daslab-testing/Llama-3.1-8B-Instruct-int-w4-a16-RTN
Updated
•
42
FP-Quant
FP-quantized models
-
-
daslab-testing/Llama-3.1-8B-Instruct-nvfp-w4-a16-RTN
Updated • 107 -
daslab-testing/Llama-3.1-8B-Instruct-mxfp-w4-a16-RTN
Updated • 8 -
daslab-testing/Llama-3.1-8B-Instruct-int-w4-a16-GPTQ
Updated • 20 -
daslab-testing/Llama-3.1-8B-Instruct-nvfp-w4-a16-GPTQ
Updated • 6 -
daslab-testing/Llama-3.1-8B-Instruct-mxfp-w4-a16-GPTQ
Updated • 6