Model

Base Model: google/gemma-2-9b-it

Dataset

custom DPO dataset

For use

Load model directly

from transformers import AutoTokenizer, AutoModelForCausalLM

tokenizer = AutoTokenizer.from_pretrained("ENERGY-DRINK-LOVE/gemma-2-9b_dpo-v4-hq")
model = AutoModelForCausalLM.from_pretrained("ENERGY-DRINK-LOVE/gemma-2-9b_dpo-v4-hq")

Downloads last month: 3,095

Safetensors

Model size

9.24B params

Tensor type

F16

Inference Providers NEW

Text Generation

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for ENERGY-DRINK-LOVE/gemma-2-9b_dpo-v4-hq

Quantizations

1 model