Exllama v2 Quantizations of Tess-v2.5.2-Qwen2-72B

Using turboderp's ExLlamaV2 v0.0.21 for quantization.

Original model: https://huggingface.co/migtissera/Tess-v2.5.2-Qwen2-72B

Downloads last month
8
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support