231 21 236

Michael Han

shimmyshimmer

https://unsloth.ai

AI & ML interests

None yet

Recent Activity

new activity about 21 hours ago

unsloth/orpheus-3b-0.1-ft-unsloth-bnb-4bit:run with "vllm serve" comes to an error: KeyError: 'layers.0.mlp.down_proj.weight.absmax'

updated a model 1 day ago

unsloth/Llama-4-Scout-17B-16E-unsloth-bnb-8bit

updated a model 1 day ago

unsloth/Llama-4-Scout-17B-16E-Instruct

View all activity

Organizations

shimmyshimmer's activity

New activity in unsloth/orpheus-3b-0.1-ft-unsloth-bnb-4bit about 21 hours ago

run with "vllm serve" comes to an error: KeyError: 'layers.0.mlp.down_proj.weight.absmax'

#1 opened 13 days ago by

ly0303521

New activity in unsloth/README 2 days ago

Request for GGUF of MAI-DS-R1

#8 opened 5 days ago by

orca-zhang

New activity in unsloth/DeepSeek-R1-GGUF 2 days ago

PLEASE make one like this for Maverick (LLaMA 4)

#50 opened 15 days ago by

Blazgo

New activity in ByteDance-Seed/UI-TARS-1.5-7B 2 days ago

Good-quality quants

#4 opened 3 days ago by

FalconNet

New activity in unsloth/Phi-4-mini-instruct-unsloth-bnb-4bit 9 days ago

Thanks!

#1 opened about 2 months ago by

FalconNet

New activity in unsloth/Llama-4-Scout-17B-16E-Instruct-unsloth-bnb-4bit 9 days ago

Model issue with 64GB ram

#4 opened 18 days ago by

llama-anon

New activity in unsloth/gemma-3-4b-it-unsloth-bnb-4bit 10 days ago

Does not work at all

#1 opened about 1 month ago by

zokica

New activity in unsloth/DeepSeek-V3-0324-GGUF 12 days ago

What tool/framework to test gguf models?

#14 opened 13 days ago by

bobchenyx

New activity in unsloth/Llama-4-Scout-17B-16E-Instruct-GGUF 13 days ago

Which quantized version can run on a Mac computer with 32GB of memory?

#2 opened 13 days ago by

jimpunk

New activity in unsloth/Llama-4-Maverick-17B-128E-Instruct-FP8 13 days ago

Please make a heavily quantized version like you did with R1

#1 opened 15 days ago by

Blazgo

New activity in unsloth/gemma-3-12b-it-GGUF 14 days ago

Model does not have vision capabilities after downloading in LM Studio, shows up as vision capable before downloading

#2 opened about 1 month ago by

alberkheijn

New activity in unsloth/gemma-3-27b-it-GGUF 14 days ago

Does not support multimodal input

#5 opened 20 days ago by

RamboRogers

New activity in unsloth/Llama-4-Scout-17B-16E-Instruct 14 days ago

GGuf Version

#5 opened 16 days ago by

apcameron

New activity in unsloth/Llama-4-Scout-17B-16E-Instruct-unsloth-dynamic-bnb-4bit 14 days ago

Vision Model?

#4 opened 16 days ago by

philbanjo

New activity in unsloth/Llama-3.2-11B-Vision-Instruct-unsloth-bnb-4bit 14 days ago

What's the difference between a model with a name 'unsloth' and a model without it?

#3 opened 15 days ago by

1sn0treal

New activity in unsloth/Llama-4-Maverick-17B-128E-Instruct-GGUF 15 days ago

text only?

#1 opened 15 days ago by

csabakecskemeti

New activity in unsloth/Llama-4-Maverick-17B-128E-Instruct 16 days ago

What are the system requirements to train this

#1 opened 17 days ago by

Blazgo

New activity in unsloth/Llama-4-Scout-17B-16E-Instruct-GGUF 16 days ago

Update README.md

#1 opened 16 days ago by

JackCloudman

New activity in unsloth/Mistral-Small-3.1-24B-Instruct-2503-unsloth-bnb-4bit 16 days ago

how i use this version model in vllm serve

#1 opened about 1 month ago by

couldn

Missing params.json

#2 opened 27 days ago by

bingw5