hugging-quants
/

Meta-Llama-3.1-8B-Instruct-AWQ-INT4

Text Generation

text-generation-inference

4-bit precision

Model card Files Files and versions Community

Resources

View closed (13)

not able to install autoawq

#18 opened 21 days ago by

Finetuning AWQ model

#17 opened 8 months ago by

add base model

#16 opened 11 months ago by

No support for num_beams >1?

#15 opened 12 months ago by

The original model supported Chinese, but the current quantized version does not. Will this issue be fixed in the future?

#14 opened 12 months ago by