File size: 301 Bytes
bca93b4 f5156b7 56dbbb4 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 |
---
library_name: transformers
tags: []
---
# Model Card for Model ID
Gemma-2-9b model, finetuned with ORPO trainer
## Training Procedure
Trained with ORPOTrainer with rsLoRA.
## Dataset
Trained on [mlabonne/orpo-dpo-mix-40k](https://huggingface.co/datasets/mlabonne/orpo-dpo-mix-40k) dataset.
|