How is this different from unsloth/gemma-3-27b-it-qat-unsloth-bnb-4bit ?
#1
by
mistycheney
- opened
How is this different from unsloth/gemma-3-27b-it-qat-unsloth-bnb-4bit ?
mistycheney
changed discussion title from
How is this different from unsloth/gemma-3-27b-it-qat-bnb-4bit?
to How is this different from unsloth/gemma-3-27b-it-qat-unsloth-bnb-4bit ?
How is this different from
unsloth/gemma-3-27b-it-qat-unsloth-bnb-4bit?
Any single model file with the 'prefix' unsloth in the name is dynamic 4-bit. Slightly bigger but much more accurate. See: https://unsloth.ai/blog/dynamic-4bit