Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
BjornMelin
's Collections
Datasets
Courses & Certifications
Single 4090 Laptop GPU
Fine Tuning
Leaderboards
Mistral
Legendary VL Models
Coding Models
Smol Quantized
Smol Models
Google
Llama
Qwen
LLMs
Smol Quantized
updated
Apr 19
My favorite quantized models under 10B parameters.
Upvote
1
bartowski/DeepSeek-R1-Distill-Qwen-14B-GGUF
Text Generation
•
Updated
Mar 10
•
75.6k
•
208
bartowski/SmallThinker-3B-Preview-GGUF
Text Generation
•
Updated
Dec 30, 2024
•
2.01k
•
28
bartowski/Qwen2.5-Coder-7B-Instruct-GGUF
Text Generation
•
Updated
Sep 19, 2024
•
4.12k
•
30
bartowski/Llama-3.2-3B-Instruct-GGUF
Text Generation
•
Updated
Oct 8, 2024
•
106k
•
135
MaziyarPanahi/Meta-Llama-3.1-8B-Instruct-GGUF
Text Generation
•
Updated
Jul 23, 2024
•
208k
•
20
bartowski/Qwen2.5-7B-Instruct-GGUF
Text Generation
•
Updated
Sep 19, 2024
•
4.89k
•
31
bartowski/Llama-3.2-3B-Instruct-uncensored-GGUF
Text Generation
•
Updated
Oct 26, 2024
•
16k
•
62
bartowski/DeepSeek-R1-Distill-Qwen-7B-GGUF
Text Generation
•
Updated
Mar 7
•
20k
•
97
bartowski/DeepSeek-R1-Distill-Llama-8B-GGUF
Text Generation
•
Updated
Jan 22
•
7.7k
•
47
microsoft/bitnet-b1.58-2B-4T
Text Generation
•
Updated
May 1
•
11.6k
•
1.06k
microsoft/bitnet-b1.58-2B-4T-gguf
Text Generation
•
Updated
May 1
•
5.53k
•
176
Upvote
1
Share collection
View history
Collection guide
Browse collections