Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Docs
  • Enterprise
  • Pricing

  • Log In
  • Sign Up

SimmonsSongHW
/
Qwen2.5-7B-Instruct-GGUF-Imatrix

GGUF
imatrix
conversational
Model card Files Files and versions Community
Qwen2.5-7B-Instruct-GGUF-Imatrix
Ctrl+K
Ctrl+K
  • 1 contributor
History: 2 commits
SimmonsSongHW's picture
SimmonsSongHW
Upload 9 files
fb504fd verified 2 months ago
  • .gitattributes
    2.11 kB
    Upload 9 files 2 months ago
  • Qwen2.5-7B-Instruct-Q2_K.gguf
    3.02 GB
    LFS
    Upload 9 files 2 months ago
  • Qwen2.5-7B-Instruct-Q3_K.gguf
    3.81 GB
    LFS
    Upload 9 files 2 months ago
  • Qwen2.5-7B-Instruct-Q4_0.gguf
    4.44 GB
    LFS
    Upload 9 files 2 months ago
  • Qwen2.5-7B-Instruct-Q4_K.gguf
    4.68 GB
    LFS
    Upload 9 files 2 months ago
  • Qwen2.5-7B-Instruct-Q5_0.gguf
    5.33 GB
    LFS
    Upload 9 files 2 months ago
  • Qwen2.5-7B-Instruct-Q5_K.gguf
    5.44 GB
    LFS
    Upload 9 files 2 months ago
  • Qwen2.5-7B-Instruct-Q6_K.gguf
    6.25 GB
    LFS
    Upload 9 files 2 months ago
  • Qwen2.5-7B-Instruct-Q8_0.gguf
    8.1 GB
    LFS
    Upload 9 files 2 months ago
  • Qwen2.5-7B-Instruct.imatrix
    4.54 MB
    LFS
    Upload 9 files 2 months ago
  • README.md
    31 Bytes
    initial commit 2 months ago