gaunernst/gemma-3-1b-it-qat-autoawq
Text Generation
•
0.4B
•
Updated
•
53
Gemma 3 QAT INT4 (from GGUF)
Convert official Gemma 3 QAT GGUF to AutoAWQ and compressed-tensors format for ease of deployment
-
-
gaunernst/gemma-3-4b-it-qat-autoawq
Image-Text-to-Text • 2B • Updated • 2.44k • 1 -
gaunernst/gemma-3-12b-it-qat-autoawq
Image-Text-to-Text • 3B • Updated • 2.97k • 6 -
gaunernst/gemma-3-27b-it-qat-autoawq
Image-Text-to-Text • 6B • Updated • 4.27k • 8 -
gaunernst/gemma-3-1b-it-qat-compressed-tensors
Text Generation • 0.4B • Updated • 2.28k -
gaunernst/gemma-3-4b-it-qat-compressed-tensors
Image-Text-to-Text • 2B • Updated • 2.46k • 1 -
gaunernst/gemma-3-12b-it-qat-compressed-tensors
Image-Text-to-Text • 3B • Updated • 2.4k • 1 -
gaunernst/gemma-3-27b-it-qat-compressed-tensors
Image-Text-to-Text • 6B • Updated • 13.2k • 9 -
google/gemma-3-1b-it-qat-q4_0-gguf
Text Generation • 1.0B • Updated • 2.62k • 71 -
google/gemma-3-4b-it-qat-q4_0-gguf
Image-Text-to-Text • 4B • Updated • 7.99k • 173 -
google/gemma-3-12b-it-qat-q4_0-gguf
Image-Text-to-Text • 12B • Updated • 92.9k • 151 -
google/gemma-3-27b-it-qat-q4_0-gguf
Image-Text-to-Text • 27B • Updated • 6.77k • 305