Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

preference-optimization

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

130

Base only

Active filters: preference-optimization

climba/hipster-flux-lora-artifacts

Text-to-Image • Updated May 22 •

sophialan/pg-map-sd15

Text-to-Image • Updated Jun 26

sophialan/pg-map-sdxl

Text-to-Image • Updated Jun 26

sophialan/pg-map-sd3

Text-to-Image • Updated Jun 26

sbc799/qwen2.5-1.5b-ultrafeedback-rdpo-adapters

Text Generation • Updated May 25

himanshunakrani9/qwen2.5-3b-ultrafeedback-dpo

Updated May 30 • 3

JaydeepR/SmolLM-135M-neuraltxt-dpo-v1

Text Generation • 0.1B • Updated Jun 1 • 12

ingeol/mistral-7b-arc-cpt-dpo

Text Generation • 7B • Updated Jun 7 • 5

chayuto/gemma-4-e2b-klondike-orpo-research

yavuz-ai/qwen3-4b-dpo-ultrafeedback-lora

Text Generation • Updated Jun 18 • 3

yavuz-ai/ministral-8b-dpo-ultrafeedback-lora

Text Generation • Updated Jun 18 • 6

sarthaksenapati/qwen1.5b-hinglish-dpo

Text Generation • Updated Jun 28 • 8

sarthaksenapati/qwen1.5b-hinglish-ipo

Text Generation • Updated Jun 30 • 6

sarthaksenapati/qwen1.5b-hinglish-kto

Text Generation • Updated Jun 30 • 4

sillykiwi/Soren-1-Small-Q8_0-GGUF

Text Generation • 2B • Updated Jun 30 • 58 • 1

Keitsuna123/llama-3.2-1b-fc-dpo

Text Generation • 1B • Updated Jul 8 • 218

amibaid/acpo-videollama2

9B • Updated Jul 9 • 16

promotion/qwen3-8b-dpo-avg-beta0p01-s42

Text Generation • 308k • Updated Jul 10 • 157

promotion/qwen3-8b-dpo-avg-beta0p05-s42

Text Generation • 308k • Updated Jul 10 • 183

promotion/qwen3-8b-ronpo-full-expect-s42

Text Generation • 8B • Updated about 1 month ago • 153

promotion/qwen3-8b-ronpo-konly-s42

Text Generation • 8B • Updated Jul 10 • 49

promotion/qwen3-8b-inpo-avg-eta0p01-s42

Text Generation • 8B • Updated Jul 10 • 64

promotion/qwen3-8b-inpo-avg-eta0p0075-s42

Text Generation • 8B • Updated Jul 10 • 148

promotion/qwen3-8b-inpo-avg-eta0p005-s42

Text Generation • 8B • Updated Jul 10 • 143

promotion/qwen3-8b-kto-avg-beta0p01-s42

Text Generation • 8B • Updated Jul 11 • 147

promotion/qwen3-8b-kto-avg-beta0p05-s42

Text Generation • 8B • Updated Jul 11 • 163

promotion/qwen3-8b-kto-avg-beta0p1-s42

Text Generation • 8B • Updated Jul 11 • 178

promotion/qwen3-8b-ipo-avg-beta0p01-s42

Text Generation • 8B • Updated Jul 11 • 168

promotion/qwen3-8b-ipo-avg-beta0p1-s42

Text Generation • 8B • Updated Jul 11 • 173

promotion/qwen3-8b-ipo-avg-beta0p5-s42

Text Generation • 8B • Updated Jul 11 • 142