Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Posts
  • Docs
  • Enterprise
  • Pricing

  • Log In
  • Sign Up

MaziyarPanahi
/
Llama-3.2-3B-Apex-GGUF

Text Generation
GGUF
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
conversational
Model card Files Files and versions Community
1
Llama-3.2-3B-Apex-GGUF
Ctrl+K
Ctrl+K
  • 1 contributor
History: 7 commits
MaziyarPanahi's picture
MaziyarPanahi
8ec019b711ee2d7aebe6fc37ef2b92e4ce28828b35cac6a84251296713b9494e
fc4e1d9 verified 7 months ago
  • .gitattributes
    1.91 kB
    8ec019b711ee2d7aebe6fc37ef2b92e4ce28828b35cac6a84251296713b9494e 7 months ago
  • Llama-3.2-3B-Apex-GGUF_imatrix.dat
    2.99 MB
    LFS
    8ec019b711ee2d7aebe6fc37ef2b92e4ce28828b35cac6a84251296713b9494e 7 months ago
  • Llama-3.2-3B-Apex.Q5_K_M.gguf
    2.59 GB
    LFS
    3e2893ad9182ffc3d26756db638978feb0f7c020f3659ad89d99db5085c59948 7 months ago
  • Llama-3.2-3B-Apex.Q5_K_S.gguf
    2.54 GB
    LFS
    5a2f6ac9664a91fb3ea03b88f41a437d41deaf6b15aa4e56f66d63ff13ea4d2f 7 months ago
  • Llama-3.2-3B-Apex.Q6_K.gguf
    2.97 GB
    LFS
    38a45e630e3a2d25399c2061fa34dbe90f339f789a3c2a345986a536a5ad2397 7 months ago
  • Llama-3.2-3B-Apex.Q8_0.gguf
    3.84 GB
    LFS
    caee57d3c5b014e78a8b089a7cb71dc88b290dc9923a24e07be4ee4d4fd4a65e 7 months ago
  • Llama-3.2-3B-Apex.fp16.gguf
    7.22 GB
    LFS
    cf9a7ecd56b642b93a01534518c08fd56b7df2c8d02f73b882aa447d3dac8b3c 7 months ago
  • README.md
    2.96 kB
    8ec019b711ee2d7aebe6fc37ef2b92e4ce28828b35cac6a84251296713b9494e 7 months ago