Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
ubermenchh
/
SmolLM2-DPO-ultrafeedback-binarized-preferences
like
0
Text Generation
Transformers
Safetensors
llama
Generated from Trainer
smol-course
module_1
trl
dpo
conversational
text-generation-inference
arxiv:
2305.18290
Model card
Files
Files and versions
Community
Train
Deploy
Use this model
main
SmolLM2-DPO-ultrafeedback-binarized-preferences
Commit History
End of training
c0db0bf
verified
ubermenchh
commited on
Feb 2
initial commit
6d73cf7
verified
ubermenchh
commited on
Feb 2
ubermenchh
commited on
ubermenchh
commited on
