Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Docs
  • Enterprise
  • Pricing

  • Log In
  • Sign Up

MaziyarPanahi
/
T3qT3qm7xp-7B-GGUF

Text Generation
Transformers
GGUF
Safetensors
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
Merge
mergekit
lazymergekit
automerger
text-generation-inference
Model card Files Files and versions Community
1
T3qT3qm7xp-7B-GGUF
Ctrl+K
Ctrl+K
  • 1 contributor
History: 9 commits
MaziyarPanahi's picture
MaziyarPanahi
9b7950d4b1bfa4c915b9ef628e7ffe9951764701c9e279856b922dd4921df786
4db3e50 verified about 1 year ago
  • .gitattributes
    2.01 kB
    9b7950d4b1bfa4c915b9ef628e7ffe9951764701c9e279856b922dd4921df786 about 1 year ago
  • T3qT3qm7xp-7B.Q2_K.gguf
    2.72 GB
    LFS
    1b8060ff835d6a8049b357ac1d3a04a0bb59bd53b11d0c2e88dc3cb5e65bbfa6 about 1 year ago
  • T3qT3qm7xp-7B.Q3_K_L.gguf
    3.82 GB
    LFS
    521affd489dfcb7620fd8fcde89314ee742dc50f86b8581557093b2b3952abeb about 1 year ago
  • T3qT3qm7xp-7B.Q3_K_M.gguf
    3.52 GB
    LFS
    8cb53a6699e427879fc44a8f8814ef076b8bea6f1cc7ec83784e9192f37c9549 about 1 year ago
  • T3qT3qm7xp-7B.Q3_K_S.gguf
    3.16 GB
    LFS
    d02d2ecb4aa37a106c74b4e60e4147aedccfbaef205b9052016a921f36804e2e about 1 year ago
  • T3qT3qm7xp-7B.Q4_K_M.gguf
    4.37 GB
    LFS
    01d372174bbcd9178c6bd109aeb7af69d78b1c2e58d8a256fb76602946d62646 about 1 year ago
  • T3qT3qm7xp-7B.Q4_K_S.gguf
    4.14 GB
    LFS
    e6281ea2e821b91c05db6e4ba228cf47c4f548ba4648fa4bf259dc229ecfa374 about 1 year ago
  • T3qT3qm7xp-7B.Q5_K_M.gguf
    5.13 GB
    LFS
    aa89c4a9a9d665203a17c81453d7a6a0d74f70f79d0e855e379b913b842bb805 about 1 year ago
  • T3qT3qm7xp-7B.Q5_K_S.gguf
    5 GB
    LFS
    9b7950d4b1bfa4c915b9ef628e7ffe9951764701c9e279856b922dd4921df786 about 1 year ago