kaitchup
/

Llama-3.1-8B-Instruct-AutoRoundGPTQ-8bit

Text Generation

text-generation-inference

8-bit precision

Model card Files Files and versions Community

Llama-3.1-8B-Instruct-AutoRoundGPTQ-8bit

Commit History

Upload tokenizer

fc491a8
verified

bnjmnmarie commited on Feb 22

Upload LlamaForCausalLM

8bb461d
verified

bnjmnmarie commited on Feb 22

initial commit

f15131d
verified

bnjmnmarie commited on Feb 22