Load 4bit models 4x faster - a unsloth Collection

unsloth 's Collections

Unsloth 4-bit Dynamic Quants

Gemma 3

Deepseek V3 (All Versions)

DeepSeek R1 (All Versions)

Mistral Small 3 (All Versions)

Phi-4 (All Versions)

Llama 3.3 (All Versions)

Qwen2.5-VL (All Versions)

Qwen QwQ-32B Collection

Vision/multimodal Models

Llama 3.2 Vision

Llama 3.1 Collection

Load 4bit models 4x faster

4bit Instruct Models

Load 4bit models 4x faster

updated 2 days ago

Native bitsandbytes 4bit pre quantized models

unsloth/Llama-3.2-3B-bnb-4bit

Text Generation • Updated Jan 23 • 23.6k • 11
unsloth/Meta-Llama-3.1-8B-bnb-4bit

Text Generation • Updated Feb 15 • 120k • 101
unsloth/llama-3-8b-Instruct-bnb-4bit

Text Generation • Updated Nov 22, 2024 • 51.7k • 132
unsloth/gemma-2-9b-bnb-4bit

Text Generation • Updated Nov 22, 2024 • 31.3k • 27
unsloth/Meta-Llama-3.1-70B-bnb-4bit

Text Generation • Updated Nov 22, 2024 • 5.6k • 31
unsloth/llama-3-8b-bnb-4bit

Text Generation • Updated Jan 7 • 84k • 197
unsloth/Llama-3.2-11B-Vision-Instruct-bnb-4bit

Image-Text-to-Text • Updated Dec 10, 2024 • 31.2k • 74
unsloth/Mistral-Nemo-Base-2407-bnb-4bit

Text Generation • Updated Feb 2 • 3.49k • 17
unsloth/mistral-7b-v0.3-bnb-4bit

Text Generation • Updated Nov 22, 2024 • 25.1k • 16
unsloth/llama-3-70b-bnb-4bit

Text Generation • Updated Nov 22, 2024 • 2.06k • 46
unsloth/gemma-2-27b-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 2.75k • 14
unsloth/mistral-7b-bnb-4bit

Text Generation • Updated Sep 11, 2024 • 29.1k • 26
unsloth/Meta-Llama-3.1-405B-bnb-4bit

Text Generation • Updated Sep 11, 2024 • 1.17k • 16
unsloth/mistral-7b-v0.2-bnb-4bit

Text Generation • Updated Sep 11, 2024 • 321 • 14
unsloth/Llama-3.2-1B-bnb-4bit

Text Generation • Updated Jan 22 • 36.1k • 14
unsloth/gemma-7b-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 4.27k • 18
unsloth/llama-2-7b-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 17k • 10
unsloth/tinyllama-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 7.26k • 11
unsloth/gemma-2b-it-bnb-4bit

Text Classification • Updated Sep 3, 2024 • 923 • 20
unsloth/llama-2-13b-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 3.94k • 5
unsloth/zephyr-sft-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 3.13k • 5
unsloth/Meta-Llama-3.1-405B-Instruct-bnb-4bit

Text Generation • Updated Sep 11, 2024 • 317 • 6
unsloth/codellama-34b-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 822 • 4
unsloth/gemma-2b-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 5.43k • 16
unsloth/codellama-7b-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 3.72k • 7