Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
ubermenchh
/
SmolLM2-DPO-ultrafeedback-binarized-preferences
like
0
Text Generation
Transformers
Safetensors
llama
Generated from Trainer
smol-course
module_1
trl
dpo
conversational
text-generation-inference
arxiv:
2305.18290
Model card
Files
Files and versions
Community
Train
Deploy
Use this model
6d73cf7
SmolLM2-DPO-ultrafeedback-binarized-preferences
Ctrl+K
Ctrl+K
1 contributor
History:
1 commit
ubermenchh
initial commit
6d73cf7
verified
4 months ago
.gitattributes
Safe
1.52 kB
initial commit
4 months ago