Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Posts
  • Docs
  • Enterprise
  • Pricing

  • Log In
  • Sign Up

MaziyarPanahi
/
MistralNemoTiny-GGUF

Text Generation
GGUF
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
conversational
Model card Files Files and versions Community
1
MistralNemoTiny-GGUF
Ctrl+K
Ctrl+K
  • 1 contributor
History: 7 commits
MaziyarPanahi's picture
MaziyarPanahi
84a78764591fa60375b38104ffd6a77c1c09825580a0a40501ae4fe6a8e90627
ce7faef verified 7 months ago
  • .gitattributes
    1.9 kB
    84a78764591fa60375b38104ffd6a77c1c09825580a0a40501ae4fe6a8e90627 7 months ago
  • MistralNemoTiny-GGUF_imatrix.dat
    2.12 MB
    LFS
    84a78764591fa60375b38104ffd6a77c1c09825580a0a40501ae4fe6a8e90627 7 months ago
  • MistralNemoTiny.Q5_K_M.gguf
    3.33 GB
    LFS
    57b1c35a02aa9db05b53bfd3c990bd58c4a6649cdde96a203aba9b1d023628ed 7 months ago
  • MistralNemoTiny.Q5_K_S.gguf
    3.27 GB
    LFS
    ccbde29cef9e4e6e046ed91a76122952d8acd6e23ec7ffd76e6358b23a90339c 7 months ago
  • MistralNemoTiny.Q6_K.gguf
    3.79 GB
    LFS
    722a5179567cce709274d67d238e61841ac1139bf6f1923856831eea8581cb41 7 months ago
  • MistralNemoTiny.Q8_0.gguf
    4.91 GB
    LFS
    23ac210aba0f86046dcc93d73f380d99991d4989c25ffc6e123c8c13caacd342 7 months ago
  • MistralNemoTiny.fp16.gguf
    9.24 GB
    LFS
    02407c0740086345f6e19a2fb2fffb293fdc9e6a96111a1c46df061a160fe1b8 7 months ago
  • README.md
    2.92 kB
    84a78764591fa60375b38104ffd6a77c1c09825580a0a40501ae4fe6a8e90627 7 months ago