Sunshine279
/

gammaPO-gemma-2-9b-it

alignment-handbook

Generated from Trainer

Model card Files Files and versions Community

Sunshine279 commited on 28 days ago

Commit

890c019

·

verified ·

1 Parent(s): 0e99e25

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -15,7 +15,7 @@ license: mit
 ### Model Description
-We fine-tuned google/gemma-2-9b-it on princeton-nlp/gemma2-ultrafeedback-armorm with the $\gamma$-SimPO objective.
  - Developed by: Jie Sun, Junkang Wu, Jiancan Wu, Zhibo Zhu, Xingyu Lu, Jun Zhou, Lintao Ma, Xiang Wang

 ### Model Description
+We fine-tuned [google/gemma-2-9b-it](https://huggingface.co/google/gemma-2-9b-it) on [princeton-nlp/gemma2-ultrafeedback-armorm](https://huggingface.co/datasets/princeton-nlp/gemma2-ultrafeedback-armorm) with the gamma-SimPO objective.
  - Developed by: Jie Sun, Junkang Wu, Jiancan Wu, Zhibo Zhu, Xingyu Lu, Jun Zhou, Lintao Ma, Xiang Wang