Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Docs
  • Enterprise
  • Pricing

  • Log In
  • Sign Up

turboderp
/
Qwen2.5-14B-Instruct-exl3

Model card Files Files and versions Community
1
Qwen2.5-14B-Instruct-exl3 / README.md
turboderp's picture
turboderp
Update README.md
5337571 verified 3 months ago
preview code
|
raw
history blame contribute delete
1.2 kB
metadata
license: apache-2.0
license_link: https://huggingface.co/Qwen/Qwen2.5-14B-Instruct/blob/main/LICENSE

EXL3 quants of Qwen2.5-14B-Instruct

2.00 bits per weight
2.25 bits per weight
2.50 bits per weight
3.00 bits per weight
3.50 bits per weight
4.00 bits per weight
5.00 bits per weight
6.00 bits per weight
8.00 bits per weight
8.00 bits per weight / H8