daslab-testing
/

Llama-3.1-8B-Instruct-nvfp-w4-a16-RTN

Model card Files Files and versions Community

No model card

Downloads last month: 107

Safetensors

Model size

8.03B params

Tensor type

F16

·

Inference Providers NEW

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Collection including daslab-testing/Llama-3.1-8B-Instruct-nvfp-w4-a16-RTN

FP-Quant

FP-quantized models • 6 items • Updated 20 days ago