This model is fine-tuned from the tanliboy/zephyr-gemma-2-9b model using the SelectiveDPO on the Ultrafeedback_binarized dataset.

For the recipe to reproduce this model, please visit our GitHub page.

Safetensors

Model size

9.24B params

Tensor type

F32

Inference Providers NEW

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for glorgao/SelectiveDPO-Gemma2-9B-SFT-UFBinarized

Base model

Finetuned

Finetuned

(2)

this model

Dataset used to train glorgao/SelectiveDPO-Gemma2-9B-SFT-UFBinarized