Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Docs
  • Enterprise
  • Pricing

  • Log In
  • Sign Up

mradermacher
/
FastLlama-3.2-1B-Instruct-GGUF

Transformers
GGUF
math
lora
science
chemistry
biology
code
text-generation-inference
unsloth
llama
conversational
Model card Files Files and versions
xet
Community
FastLlama-3.2-1B-Instruct-GGUF
Ctrl+K
Ctrl+K
  • 1 contributor
History: 17 commits
mradermacher's picture
mradermacher
auto-patch README.md
209e171 verified 6 months ago
  • .gitattributes
    2.47 kB
    uploaded from db1 6 months ago
  • FastLlama-3.2-1B-Instruct.IQ4_XS.gguf
    748 MB
    xet
    uploaded from db1 6 months ago
  • FastLlama-3.2-1B-Instruct.Q2_K.gguf
    581 MB
    xet
    uploaded from db1 6 months ago
  • FastLlama-3.2-1B-Instruct.Q3_K_L.gguf
    733 MB
    xet
    uploaded from db1 6 months ago
  • FastLlama-3.2-1B-Instruct.Q3_K_M.gguf
    691 MB
    xet
    uploaded from db1 6 months ago
  • FastLlama-3.2-1B-Instruct.Q3_K_S.gguf
    642 MB
    xet
    uploaded from db1 6 months ago
  • FastLlama-3.2-1B-Instruct.Q4_0_4_4.gguf
    771 MB
    xet
    uploaded from db1 6 months ago
  • FastLlama-3.2-1B-Instruct.Q4_K_M.gguf
    808 MB
    xet
    uploaded from db1 6 months ago
  • FastLlama-3.2-1B-Instruct.Q4_K_S.gguf
    776 MB
    xet
    uploaded from db1 6 months ago
  • FastLlama-3.2-1B-Instruct.Q5_K_M.gguf
    912 MB
    xet
    uploaded from db1 6 months ago
  • FastLlama-3.2-1B-Instruct.Q5_K_S.gguf
    893 MB
    xet
    uploaded from db1 6 months ago
  • FastLlama-3.2-1B-Instruct.Q6_K.gguf
    1.02 GB
    xet
    uploaded from db1 6 months ago
  • FastLlama-3.2-1B-Instruct.Q8_0.gguf
    1.32 GB
    xet
    uploaded from db1 6 months ago
  • FastLlama-3.2-1B-Instruct.f16.gguf
    2.48 GB
    xet
    uploaded from db1 6 months ago
  • README.md
    3.8 kB
    auto-patch README.md 6 months ago