README.md

metadata

library_name: transformers
tags: []

Model Card for Model ID

Gemma-2-9b model, finetuned with ORPO trainer

Training Procedure

Trained with ORPOTrainer with rsLoRA.

Dataset

Trained on mlabonne/orpo-dpo-mix-40k dataset.