ggml-org/gemma-3n-E4B-it-GGUF

This version does not contain multimodal support. We are still working on adding multimodal.

Gemma 3n model card

Original model: https://huggingface.co/google/gemma-3n-E4B-it

Model Page: Gemma 3n

Resources and Technical Documentation:

• Responsible Generative AI Toolkit
• Gemma on Kaggle
• Gemma on HuggingFace
• Gemma on Vertex Model Garden

Terms of Use: Terms
Authors: Google DeepMind

Example usage

With llama.cpp

To install llama.cpp on your system, see installation guide

llama-cli -m ggml-org/gemma-3n-E4B-it-GGUF:Q8_0

With LM Studio

Search for gemma-3n-E4B-it-GGUF and add it to your model library