Hugging Face's logo

unsloth
/
gemma-3-27b-it-qat-unsloth-bnb-4bit

Image-Text-to-Text
Transformers
Safetensors
gemma3
unsloth
gemma
google
conversational
text-generation-inference
4-bit precision
bitsandbytes
Model card Files
xet
Community
2

Unable to load into TGI

#1
by kreshladoge - opened
Discussion
kreshladoge

Shape error during initialization of model with TGI. Similiar as https://huggingface.co/unsloth/gemma-3-4b-it-bnb-4bit/discussions/1

Sign up or log in to comment