Unsloth AI

Enterprise

company

Verified

https://unsloth.ai

unslothai

unslothai

AI & ML interests

Hey! We're focusing on making AI more accessible to everyone!

Recent Activity

danielhanchen updated a model about 15 hours ago

unsloth/DeepSeek-R1-GGUF

danielhanchen updated a model about 16 hours ago

unsloth/DeepSeek-R1-GGUF-UD

danielhanchen updated a model about 19 hours ago

unsloth/Llama-4-Scout-17B-16E-Instruct-GGUF

View all activity

unsloth's activity

danielhanchen

updated a model about 15 hours ago

unsloth/DeepSeek-R1-GGUF

Text Generation • Updated about 15 hours ago • 1.99M • 1.04k

danielhanchen

updated a model about 16 hours ago

unsloth/DeepSeek-R1-GGUF-UD

Text Generation • Updated about 16 hours ago • 319

danielhanchen

updated 2 models about 19 hours ago

unsloth/Llama-4-Scout-17B-16E-Instruct-GGUF

Image-Text-to-Text • Updated about 19 hours ago • 160k • 69

unsloth/Mistral-Small-3.1-24B-Instruct-2503-GGUF

Updated about 19 hours ago • 18.1k • 24

danielhanchen

updated 2 models about 20 hours ago

unsloth/gemma-3-27b-it-GGUF

Image-Text-to-Text • Updated about 20 hours ago • 111k • 97

unsloth/Llama-3.1-8B-Instruct-GGUF

Updated about 20 hours ago

danielhanchen

published a model about 20 hours ago

unsloth/Llama-3.1-8B-Instruct-GGUF

Updated about 20 hours ago

danielhanchen

updated 3 models about 20 hours ago

unsloth/Mistral-Small-3.1-24B-Instruct-2503

Updated about 20 hours ago • 2.22k • 9

unsloth/Llama-3.1-8B-Instruct

Text Generation • Updated about 20 hours ago • 38.3k • 3

unsloth/gemma-3-4b-it-qat-GGUF

Updated about 20 hours ago • 267 • 1

danielhanchen

updated 2 models about 21 hours ago

unsloth/gemma-3-4b-it-qat

Image-Text-to-Text • Updated about 21 hours ago • 17

unsloth/gemma-3-27b-it-qat

Image-Text-to-Text • Updated about 21 hours ago • 25 • 1

shimmyshimmer

in unsloth/orpheus-3b-0.1-ft-unsloth-bnb-4bit about 21 hours ago

run with "vllm serve" comes to an error: KeyError: 'layers.0.mlp.down_proj.weight.absmax'

#1 opened 13 days ago by

danielhanchen

updated a model about 21 hours ago

unsloth/gemma-3-27b-it

Image-Text-to-Text • Updated about 21 hours ago • 16.5k • 8

danielhanchen

updated 2 models about 22 hours ago

unsloth/gemma-3-12b-it-qat-int4-GGUF

Image-Text-to-Text • Updated about 22 hours ago • 418 • 1

unsloth/gemma-3-12b-it-qat-int4

Image-Text-to-Text • Updated about 22 hours ago • 3 • 1

danielhanchen

updated a model about 24 hours ago

unsloth/gemma-3-12b-it-qat

Image-Text-to-Text • Updated about 24 hours ago • 66

danielhanchen

posted an update 16 days ago

Post

4684

You can now run Llama 4 on your own local device! 🦙
Run our Dynamic 1.78-bit and 2.71-bit Llama 4 GGUFs:
unsloth/Llama-4-Scout-17B-16E-Instruct-GGUF

You can run them on llama.cpp and other inference engines. See our guide here: https://docs.unsloth.ai/basics/tutorial-how-to-run-and-fine-tune-llama-4

1 reply

·

danielhanchen

posted an update 24 days ago

Post

3360

You can now run DeepSeek-V3-0324 on your own local device!
Run our Dynamic 2.42 and 2.71-bit DeepSeek GGUFs: unsloth/DeepSeek-V3-0324-GGUF

You can run them on llama.cpp and other inference engines. See our guide here: https://docs.unsloth.ai/basics/tutorial-how-to-run-deepseek-v3-0324-locally

danielhanchen

posted an update 3 months ago

Post

3103

I uploaded DeepSeek R1 GGUFs!

unsloth/DeepSeek-R1-Distill-Llama-8B-GGUF
unsloth/DeepSeek-R1-Distill-Llama-70B-GGUF
2bit for MoE: unsloth/DeepSeek-R1-GGUF
unsloth/DeepSeek-R1-Zero-GGUF

More at unsloth/deepseek-r1-all-versions-678e1c48f5d2fce87892ace5