Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Posts
  • Docs
  • Enterprise
  • Pricing

  • Log In
  • Sign Up

MaziyarPanahi
/
huihui-ai-abliteratedV2-Qwen2.5-14B-Inst-BaseMerge-TIES-GGUF

Text Generation
GGUF
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
conversational
Model card Files Files and versions Community
1
huihui-ai-abliteratedV2-Qwen2.5-14B-Inst-BaseMerge-TIES-GGUF
Ctrl+K
Ctrl+K
  • 1 contributor
History: 7 commits
MaziyarPanahi's picture
MaziyarPanahi
a86258ee1d01e8ff9d6e72b9094ef1cab7018ddbbab991655cbaa121dd622ac6
fd34fa2 verified 4 months ago
  • .gitattributes
    2.14 kB
    a86258ee1d01e8ff9d6e72b9094ef1cab7018ddbbab991655cbaa121dd622ac6 4 months ago
  • README.md
    3.35 kB
    a86258ee1d01e8ff9d6e72b9094ef1cab7018ddbbab991655cbaa121dd622ac6 4 months ago
  • huihui-ai-abliteratedV2-Qwen2.5-14B-Inst-BaseMerge-TIES-GGUF_imatrix.dat
    8.56 MB
    LFS
    a86258ee1d01e8ff9d6e72b9094ef1cab7018ddbbab991655cbaa121dd622ac6 4 months ago
  • huihui-ai-abliteratedV2-Qwen2.5-14B-Inst-BaseMerge-TIES.Q5_K_M.gguf
    10.5 GB
    LFS
    553fd3479fb46589779f4415cae6a4cd5a4a28c0687f3e0fe9410fcadf79d378 4 months ago
  • huihui-ai-abliteratedV2-Qwen2.5-14B-Inst-BaseMerge-TIES.Q5_K_S.gguf
    10.3 GB
    LFS
    a719d215f17736e9a879bc1c49bdf05499f4947a26cf59ca1a32ed3cea516191 4 months ago
  • huihui-ai-abliteratedV2-Qwen2.5-14B-Inst-BaseMerge-TIES.Q6_K.gguf
    12.1 GB
    LFS
    41c0ef67f3e7817c5b84530dc76061d5729c6b42ed50e6f6848516755fcb7237 4 months ago
  • huihui-ai-abliteratedV2-Qwen2.5-14B-Inst-BaseMerge-TIES.Q8_0.gguf
    15.7 GB
    LFS
    6b288b94f314d024e388569c56665f163e5a6cace0ef65bb336c6dfd29880652 4 months ago
  • huihui-ai-abliteratedV2-Qwen2.5-14B-Inst-BaseMerge-TIES.fp16.gguf
    29.5 GB
    LFS
    66152d227bdaee24a7df34169b543f7d7e1a5de2be592ce76c43afc877235e79 4 months ago