ENERGY-DRINK-LOVE/gemma-2-9b_dpo-v4-hq

Model

• Base Model: google/gemma-2-9b-it

Dataset

• custom DPO dataset

For use

Load model directly

from transformers import AutoTokenizer, AutoModelForCausalLM

tokenizer = AutoTokenizer.from_pretrained("ENERGY-DRINK-LOVE/gemma-2-9b_dpo-v4-hq")
model = AutoModelForCausalLM.from_pretrained("ENERGY-DRINK-LOVE/gemma-2-9b_dpo-v4-hq")