unsloth/gemma-3n-E2B-it-GGUF
Image-Text-to-Text
•
4B
•
Updated
•
104k
•
35
MMLU Pro benchmark for GGUFs (1 shot)
Not all quantized model perform good, Go to model page's discussion, You will find my comment with MMLU score (for detailed logs)
Note Score | Model | GGUF Size 36.43 Q4_0.gguf 2.97GB 41.43 Q8_0.gguf 4.79GB
unsloth/Qwen3-30B-A3B-Thinking-2507-GGUF
31B • Updated • 32.5k • 49Note Score | Model | GGUF Size 50.00 Q4_0.gguf 17.4GB
unsloth/ERNIE-4.5-21B-A3B-PT-GGUF
Text Generation • 22B • Updated • 5.47k • 8Note Score | Model | GGUF Size 56.43 Q4_0.gguf 12.4 GB
Intel/Qwen3-30B-A3B-Instruct-2507-gguf-q2ks-mixed-AutoRound
31B • Updated • 454 • 11Note Score | Model | GGUF Size 71.2 Q2_K_S.gguf 10.7GB (from intel) 70.7 Q2_K.gguf 11.3GB (from unsloth) 76.0 Q8_0.gguf 32.5GB (from unsloth)