JayHyeon/Qwen_0.5-VDPO_3e-6-1ep_30vpo_const
Text Generation
•
Updated
•
3
Edit Models filters
Datasets with no match
mozilla-foundation/common_voice_11_0
mozilla-foundation/common_voice_7_0
HuggingFaceH4/ultrafeedback_binarized
teknium/OpenHermes-2.5
fka/awesome-chatgpt-prompts
microsoft/orca-math-word-problems-200k
HuggingFaceH4/ultrachat_200k
allenai/MADLAD-400
m-a-p/CodeFeedback-Filtered-Instruction
cis-lmu/Glot500
marsyas/gtzan
Open-Orca/OpenOrca
cognitivecomputations/dolphin-coder
allenai/c4
LDJnr/Capybara
bigcode/starcoderdata
jondurbin/gutenberg-dpo-v0.1
cognitivecomputations/samantha-data
cerebras/SlimPajama-627B
allenai/nllb
Open-Orca/SlimOrca
Intel/orca_dpo_pairs
oscar-corpus/OSCAR-2109
kiranpantha/dataset-for-peft-cv-nepds
garage-bAInd/Open-Platypus
TIGER-Lab/MathInstruct
meta-math/MetaMathQA
open-r1/OpenR1-Math-220k
legacy-datasets/wikipedia
jondurbin/truthy-dpo-v0.1
AI-MO/NuminaMath-TIR
mozilla-foundation/common_voice_13_0
databricks/databricks-dolly-15k
anthracite-org/kalo-opus-instruct-22k-no-refusal
AI-MO/NuminaMath-CoT
OpenAssistant/oasst1
tiiuae/falcon-refinedweb
m-a-p/Code-Feedback
google/fleurs
EleutherAI/pile
jondurbin/airoboros-2.2.1
lmsys/lmsys-chat-1m
allenai/ultrafeedback_binarized_cleaned
togethercomputer/RedPajama-Data-1T
jondurbin/airoboros-3.2
mozilla-foundation/common_voice_17_0
facebook/voxpopuli
teknium/openhermes
uonlp/CulturaX
microsoft/orca-agentinstruct-1M-v1
HuggingFaceTB/smoltalk
PolyAI/minds14
Epiculous/Synthstruct-Gens-v1.1-Filtered-n-Cleaned
allenai/tulu-3-sft-mixture
migtissera/Synthia-v1.3
Gryphe/Sonnet3.5-Charcard-Roleplay
Epiculous/SynthRP-Gens-v1.1-Filtered-n-Cleaned
cognitivecomputations/Dolphin-2.9
ise-uiuc/Magicoder-Evol-Instruct-110K
HuggingFaceFW/fineweb
nothingiisreal/Reddit-Dirty-And-WritingPrompts
argilla/dpo-mix-7k
NousResearch/hermes-function-calling-v1
wikimedia/wikipedia
internlm/Agent-FLAN
Locutusque/function-calling-chatml
Gryphe/Sonnet3.5-SlimOrcaDedupCleaned
Vezora/Tested-22k-Python-Alpaca
yahma/alpaca-cleaned
OpenCoder-LLM/opc-sft-stage1
anthracite-org/nopm_claude_writing_fixed
nvidia/HelpSteer
OpenCoder-LLM/opc-sft-stage2
jondurbin/cinematika-v0.1
tatsu-lab/alpaca
codeparrot/apps
Anthropic/hh-rlhf
glaiveai/glaive-function-calling-v2
Nopm/Opus_WritingStruct
HuggingFaceFW/fineweb-edu
nbeerbower/gutenberg2-dpo
mlabonne/orpo-dpo-mix-40k
FreedomIntelligence/medical-o1-reasoning-SFT
unalignment/toxic-dpo-v0.2
Muennighoff/natural-instructions
mozilla-foundation/common_voice_8_0
camel-ai/math
argilla/distilabel-intel-orca-dpo-pairs
ise-uiuc/Magicoder-OSS-Instruct-75K
allenai/dolma
Active filters:
trl-lib/ultrafeedback_binarized
JayHyeon/Qwen_0.5-VIPO_3e-6-1ep_0vpo_const
Text Generation
•
Updated
•
1
JayHyeon/Qwen_0.5-VIPO_3e-6-1ep_0.3vpo_const
Text Generation
•
Updated
•
1
JayHyeon/Qwen_0.5-VDPO_3e-6-1ep_0vpo_const
Text Generation
•
Updated
•
1
JayHyeon/Qwen_0.5-VDPO_3e-6-1ep_0.3vpo_const
Text Generation
•
Updated
•
1
JayHyeon/Qwen_0.5-VDPO_3e-6-1ep_0vpo_const_exp
Text Generation
•
Updated
•
1
JayHyeon/Qwen_0.5-VDPO_3e-6-1ep_0.3vpo_const_exp
Text Generation
•
Updated
•
1
JayHyeon/Qwen_0.5-VIPO_3e-6-1ep_0vpo_const_exp
Text Generation
•
Updated
•
1
JayHyeon/Qwen_0.5-VIPO_3e-6-1ep_0.3vpo_const_exp
Text Generation
•
Updated
•
1
ComparisonPO/Llama-3-Instruct-8B-DPO
Updated
•
1
ComparisonPO/Llama-3-Instruct-8B-DPO_clean
Updated
•
1
ComparisonPO/Llama-3-Base-8B-DPO
Updated
•
1
ComparisonPO/Llama-3-Base-8B-DPO_clean
Updated
•
1
sciarrilli/Llama-3.2-3B-DPO
Updated
ComparisonPO/Llama-3-Instruct-8B-DPO-ComPO
Updated
•
2
ComparisonPO/Llama-3-Base-8B-DPO-ComPO
Updated
•
2
JayHyeon/Qwen_0.5-SLiC_5e-7-3ep
Text Generation
•
Updated
•
2
JayHyeon/Qwen_0.5-IPO_5e-7-3ep
Text Generation
•
Updated
•
1
JayHyeon/Qwen_7B-DPOP_0.5
Updated
JayHyeon/Qwen_7B-BDPO_0.5
Updated
JayHyeon/Qwen_7B-IRPO_0.5
Updated
JayHyeon/Qwen_7B-DPO_0.5
Updated
JayHyeon/Qwen_0.5-ultrainteract_BDPO_5e-7-1ep_0.5bdpo_lambda
Text Generation
•
Updated
•
14
JayHyeon/Qwen_0.5-IPO_1e-6-3ep
Text Generation
•
Updated
•
1
JayHyeon/Qwen_7B-BDPO_0.5bdpo_lam_1e-5lr_1ep
Updated
JayHyeon/Qwen_7B-DPO_0.5bdpo_lam_1e-5lr_1ep
Updated
JayHyeon/Qwen_7B-DPO_0.5bdpo_lam_1e-6lr_1ep
Updated
JayHyeon/Qwen_7B-BDPO_0.5bdpo_lam_1e-6lr_1ep
Updated
JayHyeon/Qwen_0.5-BDPO_5e-7-3ep_0.5bdpo_lambda
Text Generation
•
Updated
•
3
JayHyeon/Qwen_0.5-IPO_5e-7-3ep_0.5bdpo_lambda
Text Generation
•
Updated
•
2