Qwen2.5-32B

ExLlamav2 8 bpw quant of https://huggingface.co/Qwen/Qwen2.5-32B

Downloads last month
0
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Model tree for altomek/Qwen2.5-32B-8bpw-EXL2

Base model

Qwen/Qwen2.5-32B
Quantized
(82)
this model