kaitchup
/

Qwen2.5-32B-Instruct-AutoRoundGPTQ-8bit

Text Generation

text-generation-inference

8-bit precision

Model card Files Files and versions Community

Qwen2.5-32B-Instruct-AutoRoundGPTQ-8bit

Commit History

Upload tokenizer

a2d37e8
verified

bnjmnmarie commited on Feb 23

Upload Qwen2ForCausalLM

bcf2f84
verified

bnjmnmarie commited on Feb 23

initial commit

ccf2425
verified

bnjmnmarie commited on Feb 23