Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Docs
  • Enterprise
  • Pricing

  • Log In
  • Sign Up
Volko76 's Collections
EXL3 Quantizations
Qwen2.5 Coder Instruct GGUF
Qwen2.5 Coder Base GGUF
OpenCoder GGUF
GGUF Quantizations
EXL2 Quantizations

EXL2 Quantizations

updated Nov 20, 2024

A collection of models quantized for EXL2, one of the fastest quantisation method. https://github.com/turboderp/exllamav2

Upvote
-

  • Volko76/Qwen2.5-Coder-0.5B-Instruct-1.0bpw-exl2

    Text Generation • Updated Nov 12, 2024

  • Volko76/Qwen2.5-Coder-0.5B-Instruct-2.0bpw-exl2

    Text Generation • Updated Nov 12, 2024

  • Volko76/Qwen2.5-Coder-0.5B-Instruct-3.0bpw-exl2

    Text Generation • Updated Nov 12, 2024

  • Volko76/Qwen2.5-Coder-0.5B-Instruct-4.5bpw-exl2

    Text Generation • Updated Nov 12, 2024

  • Volko76/Qwen2.5-Coder-0.5B-Instruct-8.0bpw-exl2

    Text Generation • Updated Nov 12, 2024 • 1

  • Volko76/Qwen2.5-Coder-1.5B-Instruct-5.5bpw-exl2

    Text Generation • Updated Nov 15, 2024

  • Volko76/Qwen2.5-0.5B-Instruct-EXL2-4bits

    Text Generation • Updated Apr 27

  • Volko76/Qwen2.5-0.5B-Instruct-4.5bpw-exl2

    Text Generation • Updated Apr 27
Upvote
-
  • Collection guide
  • Browse collections
Company
TOS Privacy About Jobs
Website
Models Datasets Spaces Pricing Docs