llmware
/

gemma-2-9b-instruct-gguf

Model card Files Files and versions Community

gemma-2-9b-gguf

gemma-2-9b-gguf is a GGUF Q4_K_M int4 quantized version of Google's Gemma-2-9B with Instruct Training (IT), providing a very fast, very small inference implementation, optimized for AI PCs.

gemma-2-9b-gguf is a leading open source foundation model from Google.

Model Description

Developed by: Google
Model type: gemma-2-9b
Parameters: 9 billion
Model Parent: google/gemma-2-9b-it
Language(s) (NLP): English
License: Apache 2.0
Uses: General purpose chat
RAG Benchmark Accuracy Score: NA
Quantization: int4

Model Card Contact

llmware on github

llmware website

Downloads last month: 16

GGUF

Model size

9.24B params

Architecture

gemma2

4-bit

Inference Providers NEW

This model is not currently available via any of the supported Inference Providers.

The model cannot be deployed to the HF Inference API: The model authors have turned it off explicitly.

Model tree for llmware/gemma-2-9b-instruct-gguf

Base model

google/gemma-2-9b

Finetuned

google/gemma-2-9b-it

Quantized

(132)

this model