---
library_name: transformers
tags: []
---

# Model Card for Model ID

Gemma-2-9b model, finetuned with ORPO trainer

## Training Procedure

Trained with ORPOTrainer with rsLoRA.

## Dataset

Trained on [mlabonne/orpo-dpo-mix-40k](https://huggingface.co/datasets/mlabonne/orpo-dpo-mix-40k) dataset.