Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Posts
  • Docs
  • Enterprise
  • Pricing

  • Log In
  • Sign Up

MaziyarPanahi
/
DeepSeek-llama3.1-Bllossom-8B-GGUF

Text Generation
GGUF
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
conversational
Model card Files Files and versions Community
1
DeepSeek-llama3.1-Bllossom-8B-GGUF
Ctrl+K
Ctrl+K
  • 1 contributor
History: 7 commits
MaziyarPanahi's picture
MaziyarPanahi
4c5000d8bf3fce416d6719b3a92f7a9c13b6c28513d67289dfe86431a6986f10
4f17d80 verified 3 months ago
  • .gitattributes
    1.99 kB
    4c5000d8bf3fce416d6719b3a92f7a9c13b6c28513d67289dfe86431a6986f10 3 months ago
  • DeepSeek-llama3.1-Bllossom-8B-GGUF_imatrix.dat
    4.99 MB
    LFS
    4c5000d8bf3fce416d6719b3a92f7a9c13b6c28513d67289dfe86431a6986f10 3 months ago
  • DeepSeek-llama3.1-Bllossom-8B.Q5_K_M.gguf
    5.73 GB
    LFS
    10e8ebac8bf9bc8b25ffec8dc5474edb7c428a149fc150fe8b790fe1fa26c7c7 3 months ago
  • DeepSeek-llama3.1-Bllossom-8B.Q5_K_S.gguf
    5.6 GB
    LFS
    9cbb7cdd3924b3ce471237acb1ce2428a868cffb6081b7fcc09935df58844eed 3 months ago
  • DeepSeek-llama3.1-Bllossom-8B.Q6_K.gguf
    6.6 GB
    LFS
    d27a790c08cc82b25b5c91af6e6e0c7958c245e3906c8a00ec987842a1bcf2e3 3 months ago
  • DeepSeek-llama3.1-Bllossom-8B.Q8_0.gguf
    8.54 GB
    LFS
    2e6eacd5fc91f8482f6128fad1e4360d565383e92aed2cd091dc13e317a9cfdd 3 months ago
  • DeepSeek-llama3.1-Bllossom-8B.fp16.gguf
    16.1 GB
    LFS
    13a8c07af679b7898528795f06e3a25fa856ec18344e0d8b98bc17670db0b5c1 3 months ago
  • README.md
    3.1 kB
    4c5000d8bf3fce416d6719b3a92f7a9c13b6c28513d67289dfe86431a6986f10 3 months ago