Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Docs
  • Enterprise
  • Pricing

  • Log In
  • Sign Up

MaziyarPanahi
/
Qwen2.5-Coder-7B-Instruct-20241106-GGUF

Text Generation
GGUF
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
conversational
Model card Files Files and versions Community
1
Qwen2.5-Coder-7B-Instruct-20241106-GGUF
Ctrl+K
Ctrl+K
  • 1 contributor
History: 7 commits
MaziyarPanahi's picture
MaziyarPanahi
5b99a8cb5350e11f5b6eee01ba9e565dfd77770da917ef301f734a2d58f57650
45ac20a verified 9 months ago
  • .gitattributes
    2.02 kB
    5b99a8cb5350e11f5b6eee01ba9e565dfd77770da917ef301f734a2d58f57650 9 months ago
  • Qwen2.5-Coder-7B-Instruct-20241106-GGUF_imatrix.dat
    4.54 MB
    LFS
    5b99a8cb5350e11f5b6eee01ba9e565dfd77770da917ef301f734a2d58f57650 9 months ago
  • Qwen2.5-Coder-7B-Instruct-20241106.Q5_K_M.gguf
    5.44 GB
    LFS
    1b551cfbd7819cecd4b8259e6ddf037081891b45711c939d91e71d81219ca9f5 9 months ago
  • Qwen2.5-Coder-7B-Instruct-20241106.Q5_K_S.gguf
    5.32 GB
    LFS
    d9762d3d5e5c66517d00beb1b36bd32a28ab166e9b149c300714bdcd1f3eedf7 9 months ago
  • Qwen2.5-Coder-7B-Instruct-20241106.Q6_K.gguf
    6.25 GB
    LFS
    ef17c29335f133f59d5737d848a899d64c84d09119394d398518c1d88dbb02af 9 months ago
  • Qwen2.5-Coder-7B-Instruct-20241106.Q8_0.gguf
    8.1 GB
    LFS
    45865a696fee1e847ccfb5c34c4038219fefa55244b5c8292cfa90ff91035581 9 months ago
  • Qwen2.5-Coder-7B-Instruct-20241106.fp16.gguf
    15.2 GB
    LFS
    1971000d2ae86bb8394c6b1408db994a005b1127a2184bbb0ac8c9d16f2d0219 9 months ago
  • README.md
    3.11 kB
    5b99a8cb5350e11f5b6eee01ba9e565dfd77770da917ef301f734a2d58f57650 9 months ago