UnSloth, all I can say is Thank You
#1
by
sandlercaleb
- opened
You are truly the most on-top of it and selfless people in the open sourced AI community, I am so excited to try your version!!!
Indeed. When I saw GPT-OSS had finally released this was the first repo I jumped to.
My experience with UD quants have been nothing but great.
Yea same. Unsloth Dynamic is goated π
Thank you!
It's uploaded now!! The FP4 version. Please update whichever inference engine youre using! with some chat template fixes
Dynamic GGUFs with different sizes will come later!! Thanks to llama.cpp if they update it.
CC: @Mikael110 @TDotHacker @Picklemantis @mrtime-ai @goodlucklap @Mosai-Sys @sandlercaleb