Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
CriteriaPO
/
qwen2.5-3b-orpo-coarse
like
0
Follow
CriteriaPO
3
Text Generation
Transformers
Safetensors
qwen2
Generated from Trainer
trl
orpo
conversational
text-generation-inference
arxiv:
2403.07691
Model card
Files
Files and versions
Community
Train
Deploy
Use this model
main
qwen2.5-3b-orpo-coarse
/
vocab.json
Commit History
Model save
c8dfde4
verified
obiwit
commited on
14 days ago