llmware
/

gemma-2-27b-instruct-gguf

Model card Files Files and versions Community

gemma-2-27b-gguf

gemma-2-27b-gguf is a GGUF Q4_K_M int4 quantized version of Google's Gemma-2-27B with Instruct Training (IT), providing an inference implementation, optimized for AI PCs.

gemma-2-27b-gguf is a leading open source foundation model from Google.

Model Description

Developed by: Google
Model type: gemma-2-27b
Parameters: 27 billion
Model Parent: google/gemma-2-27b-it
Language(s) (NLP): English
License: Apache 2.0
Uses: General purpose chat
RAG Benchmark Accuracy Score: NA
Quantization: int4

Model Card Contact

llmware on github

llmware website

Downloads last month: 17

GGUF

Model size

27.2B params

Architecture

gemma2

4-bit

Inference Providers NEW

This model is not currently available via any of the supported Inference Providers.

The model cannot be deployed to the HF Inference API: The model authors have turned it off explicitly.

Model tree for llmware/gemma-2-27b-instruct-gguf

Base model

google/gemma-2-27b

Finetuned

google/gemma-2-27b-it

Quantized

(56)

this model