Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Docs
  • Enterprise
  • Pricing

  • Log In
  • Sign Up
BjornMelin 's Collections
Datasets
Courses & Certifications
Single 4090 Laptop GPU
Fine Tuning
Leaderboards
Mistral
Legendary VL Models
Coding Models
Smol Quantized
Smol Models
Google
Llama
Qwen
LLMs

Smol Quantized

updated Apr 19

My favorite quantized models under 10B parameters.

Upvote
1

  • bartowski/DeepSeek-R1-Distill-Qwen-14B-GGUF

    Text Generation • Updated Mar 10 • 75.6k • 208

  • bartowski/SmallThinker-3B-Preview-GGUF

    Text Generation • Updated Dec 30, 2024 • 2.01k • 28

  • bartowski/Qwen2.5-Coder-7B-Instruct-GGUF

    Text Generation • Updated Sep 19, 2024 • 4.12k • 30

  • bartowski/Llama-3.2-3B-Instruct-GGUF

    Text Generation • Updated Oct 8, 2024 • 106k • 135

  • MaziyarPanahi/Meta-Llama-3.1-8B-Instruct-GGUF

    Text Generation • Updated Jul 23, 2024 • 208k • 20

  • bartowski/Qwen2.5-7B-Instruct-GGUF

    Text Generation • Updated Sep 19, 2024 • 4.89k • 31

  • bartowski/Llama-3.2-3B-Instruct-uncensored-GGUF

    Text Generation • Updated Oct 26, 2024 • 16k • 62

  • bartowski/DeepSeek-R1-Distill-Qwen-7B-GGUF

    Text Generation • Updated Mar 7 • 20k • 97

  • bartowski/DeepSeek-R1-Distill-Llama-8B-GGUF

    Text Generation • Updated Jan 22 • 7.7k • 47

  • microsoft/bitnet-b1.58-2B-4T

    Text Generation • Updated May 1 • 11.6k • 1.06k

  • microsoft/bitnet-b1.58-2B-4T-gguf

    Text Generation • Updated May 1 • 5.53k • 176
Upvote
1
  • Collection guide
  • Browse collections
Company
TOS Privacy About Jobs
Website
Models Datasets Spaces Pricing Docs