promotion/ronpo-qwen3-8b-fair-dpo-s42
Text Generation • 8B • Updated • 155
Edit Models filters
Model Tree
Apps
Inference Providers
One-click Deployment
Models
148
Active filters: preference-optimization
promotion/ronpo-qwen3-8b-fair-ht-mnpo-helpfulness-s42
Text Generation • 8B • Updated • 173
promotion/ronpo-qwen3-8b-fair-ht-mnpo-safety-s42
Text Generation • 8B • Updated • 206
promotion/ronpo-qwen3-8b-fair-inpo-avg-s42
Text Generation • 8B • Updated • 171
promotion/ronpo-qwen3-8b-fair-ronpo-full-expect-s42
Text Generation • 8B • Updated • 196
promotion/ronpo-qwen3-8b-fair-sppo-avg-s42
Text Generation • 8B • Updated • 239
thesreedath/slm-125m-dpo
0.1B • Updated • 17
thesreedath/slm-500m-dpo
0.5B • Updated • 21
thesreedath/slm-125m-dpo2
0.1B • Updated • 23
thesreedath/slm-500m-dpo2
0.5B • Updated • 20
thesreedath/slm-gemma-2b-dpo2
3B • Updated • 20
promotion/ronpo-llama31-saferlhf-p5-topmass-stage1-s42
8B • Updated • 45
promotion/ronpo-llama31-saferlhf-stage3-os-s42
Text Generation • 8B • Updated • 263
ayushshah/Qwen3-1.7B-Chat-LoRA
Text Generation • Updated • 48
ayushshah/Qwen3-1.7B-Chat
Text Generation • 2B • Updated • 568
promotion/ronpo-llama31-saferlhf-stage4-os-s42
Text Generation • 8B • Updated • 42
ayushshah/Qwen3-1.7B-Chat-GGUF
Text Generation • 2B • Updated • 480
Lixiaojian123/qwen3-0.6b-dpo
Text Generation • 0.6B • Updated • 31
sngwon/Qwen3-8B-usersim-dpo
Text Generation • 8B • Updated • 26
submarat/gpt2-small-fineweb-edu-10b-dpo
Text Generation • 0.1B • Updated • 40
sngwon/Qwen3-8B-usersim-online-dpo
Text Generation • 8B • Updated • 34
promotion/ronpo-maxmin-saferlhf-llama31-stage4-s42
Text Generation • 8B • Updated • 50
sarimahsan101/Qwen2.5-0.5B-DPO-detox
0.5B • Updated • 22
Manav112/llama-3.2-3b-fantasy-startsit-dpo
Updated
XujuntaoFighting/GC-DPO-diagnostic-ckpts
Text-to-Image • Updated
jackf857/Llama-3.2-1B-Instruct-DPO-HH
Text Generation • 1B • Updated • 335
iPwnds/finanalyst-qwen1.5b-final
Text Generation • Updated
prajwal55/slm-125m-dpo
Text Generation • 0.1B • Updated