Edit Models filters

Apps

Apps with no match

Inference Providers

Inference Providers with no match

HF Inference API

Misc

Inference Endpoints

text-generation-inference

4-bit precision

8-bit precision

Mixture of Experts

text-embeddings-inference

Carbon Emissions

Models

8,149

Full-text search

Active filters: dpo

mlabonne/NeuralDaredevil-8B-abliterated

Text Generation • 8B • Updated Aug 27, 2024 • 21.6k • • 213

QuantFactory/NeuralDaredevil-8B-abliterated-GGUF

Text Generation • 8B • Updated May 29, 2024 • 4.78k • 67

jpacifico/Chocolatine-2-14B-Instruct-v2.0

Text Generation • 15B • Updated 1 day ago • 26 • 3

TheBloke/CapybaraHermes-2.5-Mistral-7B-GGUF

7B • Updated Jan 31, 2024 • 7.39k • 118

sapienzanlp/Minerva-7B-instruct-v1.0

Text Generation • 7B • Updated Dec 5, 2024 • 5.48k • 20

AmberYifan/Qwen2.5-7B-Instruct-userfeedback-SFT-SPIN-iter1

Text Generation • 8B • Updated 8 days ago • 38 • 1

mradermacher/Qwen2.5-7B-Instruct-userfeedback-SFT-SPIN-iter1-GGUF

8B • Updated 7 days ago • 280 • 1

AmberYifan/Qwen2.5-7B-Instruct-userfeedback-SPIN-iter1

Text Generation • 8B • Updated 7 days ago • 31 • 1

AmberYifan/Qwen2.5-7B-Instruct-userfeedback-SPIN-iter2

Text Generation • 8B • Updated 7 days ago • 20 • 1

mradermacher/Qwen2.5-7B-Instruct-userfeedback-SPIN-iter2-GGUF

8B • Updated 6 days ago • 475 • 1

mradermacher/Qwen2.5-7B-Instruct-userfeedback-SPIN-iter1-GGUF

8B • Updated 6 days ago • 491 • 1

AmberYifan/Qwen2.5-7B-Instruct-userfeedback-4k-iter2

Text Generation • 8B • Updated 3 days ago • 15 • 1

AmberYifan/Qwen2.5-7B-Instruct-userfeedback-on-policy-iter1

Text Generation • 8B • Updated 3 days ago • 32 • 1

mradermacher/Qwen2.5-7B-Instruct-userfeedback-on-policy-iter1-GGUF

8B • Updated 2 days ago • 54 • 1

mradermacher/Qwen2.5-7B-Instruct-userfeedback-4k-iter2-GGUF

8B • Updated 2 days ago • 58 • 1

AmberYifan/Qwen2.5-7B-Instruct-userfeedback-on-policy-iter2

Text Generation • 8B • Updated 2 days ago • 14 • 1

mradermacher/Qwen2.5-7B-Instruct-userfeedback-on-policy-iter2-GGUF

8B • Updated 1 day ago • 59 • 1

lyogavin/Anima33B-DPO-Belle-1k

Text Generation • Updated Jul 2, 2023 • 1

lyogavin/Anima33B-DPO-Belle-1k-merged

Text Generation • Updated Jul 2, 2023 • 55 • 12

daekeun-ml/Llama-2-ko-DPO-13B

Text Generation • 13B • Updated Oct 31, 2023 • 3.73k • 19

lewtun/zephyr-7b-dpo-full

Text Generation • 7B • Updated Jan 5, 2024 • 16

alignment-handbook/zephyr-7b-dpo-full

Text Generation • 7B • Updated Jan 10, 2024 • 27 • 3

alignment-handbook/zephyr-7b-dpo-qlora

Updated Jan 9, 2024 • 30 • 9

argilla/notus-7b-v1-lora

Text Generation • 7B • Updated Dec 4, 2023 • 15 • 7

argilla/notus-7b-v1-lora-adapter

Text Generation • Updated Dec 4, 2023 • 3

argilla/notus-7b-v1

Text Generation • 7B • Updated Dec 5, 2023 • 125 • 122

ContextualAI/archangel_sft_pythia1-4b

Text Generation • 1B • Updated Jan 11, 2024 • 13

ContextualAI/archangel_sft_pythia2-8b

Text Generation • 3B • Updated Jan 11, 2024 • 71 • 1

ContextualAI/archangel_sft_pythia6-9b

Text Generation • 7B • Updated Jan 11, 2024 • 28

ContextualAI/archangel_sft_pythia12-0b

Text Generation • 12B • Updated Jan 11, 2024 • 16