Sleeping
1
💻
Direct Preference Optimization Datasets
Datasets suitable for DPO based on having 'chosen', 'rejected', and 'prompt' columns. Created using librarian-bots/dataset-column-search-api
Note This Space allows you to navigate through all the datasets in this collection and view their datasets viewer preview.
-
HuggingFaceH4/ultrafeedback_binarized
Viewer • Updated • 187k • 53k • 215 -
argilla/distilabel-capybara-dpo-7k-binarized
Viewer • Updated • 7.56k • 1.06k • 170 -
allenai/reward-bench
Viewer • Updated • 8.11k • 56.4k • 67 -
Dahoas/rm-static
Viewer • Updated • 81.4k • 7.56k • 106 -
princeton-nlp/llama3-ultrafeedback
Viewer • Updated • 61.8k • 6.02k • 14 -
Dahoas/full-hh-rlhf
Viewer • Updated • 125k • 4.44k • 69 -
trl-internal-testing/hh-rlhf-helpful-base-trl-style
Viewer • Updated • 46.2k • 14.3k • 6 -
tasksource/oasst1_pairwise_rlhf_reward
Viewer • Updated • 18.9k • 258 • 38 -
mlabonne/orpo-dpo-mix-40k
Viewer • Updated • 44.2k • 1.26k • 221 -
trl-internal-testing/descriptiveness-sentiment-trl-style
Viewer • Updated • 10.9k • 7.01k • 1 -
argilla/ultrafeedback-binarized-preferences-cleaned
Viewer • Updated • 60.9k • 7.79k • 116 -
princeton-nlp/mistral-instruct-ultrafeedback
Viewer • Updated • 62.7k • 5.77k • 1 -
allenai/ultrafeedback_binarized_cleaned
Viewer • Updated • 186k • 4.58k • 63 -
csarron/argilla-ultrafeedback-binarized-preferences-cleaned
Viewer • Updated • 62.9k • 398 -
princeton-nlp/llama3-ultrafeedback-armorm
Viewer • Updated • 61.8k • 8.48k • 13 -
yitingxie/rlhf-reward-datasets
Viewer • Updated • 81.4k • 858 • 59 -
HuggingFaceH4/testing_h4
Viewer • Updated • 70 • 164 -
CarperAI/openai_summarize_comparisons
Viewer • Updated • 260k • 845 • 36 -
ZhangShenao/gc_fine_ultrafeedback
Viewer • Updated • 97.1k • 2 • 1 -
sfanm/ultrafeedback_llama3_label
Viewer • Updated • 60k • 2 -
HuggingFaceH4/summarize_from_feedback
Viewer • Updated • 353k • 199 • 2 -
HuggingFaceH4/rlaif-v_formatted
Viewer • Updated • 83.1k • 784 • 1 -
zhengr/ultrafeedback_binarized
Viewer • Updated • 190k • 4 • 2 -
HuggingFaceH4/orca_dpo_pairs
Viewer • Updated • 12.9k • 97 • 22 -
Baidicoot/augmented_advbench_v4
Viewer • Updated • 4.95k • 63 -
xinlai/Math-Step-DPO-10K
Viewer • Updated • 10.8k • 1.67k • 19 -
arcee-ai/distilabel-intel-orca-dpo-pairs-binarized
Viewer • Updated • 12.9k • 1.12k • 1 -
nz/anthropic_hh_rlhf
Viewer • Updated • 169k • 42 -
trl-internal-testing/hh-rlhf-trl-style
Viewer • Updated • 169k • 1.08k • 9 -
ContextualAI/ultrabin_clean_max_chosen_rand_rejected
Viewer • Updated • 60.9k • 2 -
trl-internal-testing/sentiment-trl-style
Viewer • Updated • 5.48k • 258 -
ZhangShenao/gc_fine_ultrafeedback_nosys
Viewer • Updated • 97.1k • 18 -
trl-internal-testing/tldr-preference-trl-style
Viewer • Updated • 179k • 771 • 2 -
Syed-Hasan-8503/orpo-40k-train-test
Viewer • Updated • 44.2k • 2 -
allenai/preference-test-sets
Viewer • Updated • 43.2k • 462 • 17 -
ZhangShenao/gc_posonly_fine_ultrafeedback
Viewer • Updated • 49.6k • 2 -
maywell/ko_Ultrafeedback_binarized
Viewer • Updated • 62k • 171 • 28 -
SAGI-1/Greetings_DPO_dataset_V1
Viewer • Updated • 891 • 34 • 3 -
ContextualAI/ultrafeedback_binarized_1percent
Viewer • Updated • 200 • 648 -
HuggingFaceH4/cai-conversation-harmless
Viewer • Updated • 44.8k • 120 • 13 -
ZhangShenao/gc_ultrafeedback
Viewer • Updated • 97.1k • 2 -
HuggingFaceH4/h4-tests-format-dpo-dataset
Viewer • Updated • 1 • 56 -
when2rl/tldr-summarisation-preferences_reformatted
Viewer • Updated • 177k • 2 -
Xalphinions/llama3_ultrafeedback_with_tie_armorm
Viewer • Updated • 61.8k • 162 -
mnoukhov/openai_summarize_comparisons_tldrprompt_relabel1b
Viewer • Updated • 97.5k • 4 -
alvarobartt/dpo-mix-7k-simplified
Viewer • Updated • 7.5k • 2 • 11 -
Magpie-Align/Magpie-Pro-DPO-200K
Viewer • Updated • 207k • 8 • 5 -
pharaouk/ultrafeedback-binarized-preferences-cleaned
Viewer • Updated • 60.9k • 3 -
Xalphinions/UltraFeedback_with_tie_strict
Viewer • Updated • 65.1k • 2 -
ContextualAI/ultrabin_clean_max_chosen_min_rejected
Viewer • Updated • 60.9k • 146 -
beyond/rlhf-reward-single-round-trans_chinese
Viewer • Updated • 24.9k • 9 • 36 -
ZhangShenao/gc_binarized_ultrafeedback
Viewer • Updated • 109k • 2 -
mlabonne/orpo-dpo-mix-40k-flat
Viewer • Updated • 44.2k • 209 • 5 -
valerielucro/gsm8k_preference_dataset
Viewer • Updated • 895 • 2 -
Katayoon/SELM-Zephyr-7B-dataset
Viewer • Updated • 51.8k • 2 -
trl-internal-testing/mlabonne-chatml-dpo-pairs-copy
Viewer • Updated • 12.9k • 9.32k -
yuasosnin/imdb-dpo
Viewer • Updated • 10k • 668 -
Xalphinions/UltraFeedback_with_tie
Viewer • Updated • 133k • 2 -
gx-ai-architect/HelpSteer2_DPO
Viewer • Updated • 7.59k • 4 • 1 -
yaswanthchittepu/ultrafeedback-binarized-standard-margin-data-full
Viewer • Updated • 63.7k • 2 -
smangrul/ultrachat-feedback-10k-chatml
Viewer • Updated • 12k • 105 -
Synadapt/Orpo_Split_Turns_v1_clean_ready
Viewer • Updated • 8.1k • 2 -
YYYYYYibo/ultrafeedback_binarized_with_response_full_part0
Viewer • Updated • 20k • 6 -
youjunhyeok/ko-orca-pair-and-ultrafeedback-dpo
Viewer • Updated • 72.5k • 41 • 1 -
xiaodongguaAIGC/awesome-dpo
Viewer • Updated • 302k • 2 • 2 -
Xalphinions/llama3_ultrafeedback_with_tie
Viewer • Updated • 61.8k • 2 -
pythainlp/oasst2_dpo_pairs_enth
Viewer • Updated • 5.28k • 3 • 1 -
banghua/tldr_reward_model_labeled
Viewer • Updated • 176k • 240 -
abhayesian/augmented_advbench_v5
Viewer • Updated • 4.95k • 36 -
cyberagent/chatbot-arena-ja-calm2-7b-chat-experimental
Viewer • Updated • 29.2k • 4 • 16 -
argilla/OpenHermesPreferences
Viewer • Updated • 989k • 523 • 188 -
snorkelai/Snorkel-Mistral-PairRM-DPO-Dataset
Viewer • Updated • 62.7k • 13 • 42 -
Windy/4rewriter_simpo_distrib4_onraw
Viewer • Updated • 8.77k • 2 -
dinaaaaaa/lima_rand_sel_50_preference
Viewer • Updated • 500 • 2 -
yaswanthchittepu/ultrafeedback-binarized-pop-margin-data-full
Viewer • Updated • 63.7k • 2 -
kira/math-dpo
Viewer • Updated • 2.42k • 5 • 5 -
YYYYYYibo/ultrafeedback_binarized_with_response_full_part1
Viewer • Updated • 20k • 16 -
Columbia-NLP/DPO-HelpSteer
Viewer • Updated • 9.17k • 2 -
Windy/test_simpo_distrib4_onraw
Viewer • Updated • 14k • 2 -
mnoukhov/summarize_from_feedback_oai_preprocessing_1706381144_relabel_pythia6.9b
Viewer • Updated • 177k • 2 -
nebchi/kor-orpo
Viewer • Updated • 98.1k • 2 -
YYYYYYibo/ultrafeedback_binarized_with_response_full_part2
Viewer • Updated • 21.1k • 14 -
Windy/ultr4_v3_t1_trlsft_mv1_ranksim_top1
Viewer • Updated • 15k • 2 -
ZhangShenao/gc_fine_posonly_ultrafeedback_nosys
Viewer • Updated • 49.6k • 2 -
aklein4/tldr-feedback
Viewer • Updated • 179k • 2 -
wenbopan/Chinese-dpo-pairs
Viewer • Updated • 10.7k • 146 • 35 -
HuggingFaceH4/grok-conversation-harmless
Viewer • Updated • 44.8k • 49 • 21 -
BramVanroy/ultra_feedback_dutch
Viewer • Updated • 53.6k • 102 • 2 -
ZHLiu627/ultrafeedback_binarized_with_response_full
Viewer • Updated • 61.1k • 2 -
RAY2L/llama3-ultrafeedback-mini
Viewer • Updated • 1.2k • 2 -
kaist-ai/Multifaceted-Collection-DPO
Viewer • Updated • 65.1k • 15 • 7 -
David-Xu/astronomy-stack-dpo-text
Viewer • Updated • 19.9k • 2 • 1 -
GitBag/multiturn-hh-turn-1-5
Viewer • Updated • 162k • 2 -
mnoukhov/summarize_from_feedback_oai_preprocessing_1706381144_relabel_pythia1b
Viewer • Updated • 177k • 2 -
yhavinga/orpo-dpo-mix-dutch-40k
Viewer • Updated • 43.1k • 2 • 1 -
zekeZZ/hh-rlhf-dpo
Viewer • Updated • 51.9k • 2 -
ZhangShenao/gc_binarized_noscore_ultrafeedback
Viewer • Updated • 109k • 2 -
Windy/test_simpo_distrib4
Viewer • Updated • 14k • 2 -
ZhangShenao/gc_posonly_fine_filterlowrej_ultrafeedback
Viewer • Updated • 84.2k • 2 -
Windy/4rewriter_simpo_distrib4
Viewer • Updated • 8.77k • 2 -
Windy/4rewriter_simpo_distrib4_rankthresh4
Viewer • Updated • 3.21k • 2 -
argilla/ultrafeedback-multi-binarized-preferences-cleaned
Viewer • Updated • 158k • 508 • 6 -
GitBag/multiturn-512-hh-turn-1-5
Viewer • Updated • 165k • 40 • 1 -
trl-internal-testing/descriptiveness-trl-style
Viewer • Updated • 5.42k • 2 • 1 -
GrowingApple/orpo_kor_translated_medical
Viewer • Updated • 10.4k • 9 • 3 -
mnoukhov/summarize_from_feedback_oai_preprocessing_1706381144
Viewer • Updated • 179k • 2 -
saulgarciahuertes/orpo_ie_dataset
Viewer • Updated • 16.4k • 2 -
minkyungpark/UFB_test_500
Viewer • Updated • 500 • 2 -
tasksource/tasksource_dpo_pairs
Viewer • Updated • 5.13M • 446 • 20 -
when2rl/SHP_reformatted
Viewer • Updated • 386k • 2 -
ContextualAI/ultrabin_clean_max_chosen_min_rejected_rationalized_instruction_following
Viewer • Updated • 60.9k • 2 • 3 -
YYYYYYibo/ultrafeedback_binarized_simple_online_train_part_1
Viewer • Updated • 20k • 2 -
tasksource/oasst2_pairwise_rlhf_reward
Viewer • Updated • 28.4k • 11 • 2 -
allenai/coconot
Viewer • Updated • 13.8k • 53 • 4 -
VictorDCh/spider-dpo-dataset
Viewer • Updated • 901 • 2 -
joshuasundance/mypo-4k-rfc
Viewer • Updated • 6.36k • 2 • 2 -
ZHLiu627/ultrafeedback_binarized_with_response_full_part0
Viewer • Updated • 20k • 2 -
Baidicoot/anthropic-harmless-rlhf
Viewer • Updated • 42.5k • 2 -
ContextualAI/ultrabin_clean_max_chosen_min_rejected_rationalized_helpfulness
Viewer • Updated • 60.9k • 2 -
ZhangShenao/gc_binarized_posonly_ultrafeedback
Viewer • Updated • 63.1k • 2 -
ZhangShenao/gc_mode_posonly_fine_ultrafeedback
Viewer • Updated • 49.6k • 2 -
Windy/ultr4_v3_t1_trlsft_mv1_ranksim
Viewer • Updated • 7.11k • 2 -
nz/ulma_anthropic_hh_golden
Viewer • Updated • 44.8k • 2 -
ThWu/dpo_openhermes
Viewer • Updated • 183k • 4 • 6 -
ZhangShenao/ultrafeedback_fine
Viewer • Updated • 182k • 1.22k -
droussis/UltraSafety_binarized-orpo-dpo
Viewer • Updated • 2.26k • 25 • 2 -
Baidicoot/anthropic-hh-rlhf
Viewer • Updated • 169k • 4 -
abacusai/MetaMath_DPO_FewShot
Viewer • Updated • 395k • 140 • 22 -
reciprocate/ultrafeedback_orca_math_dpo
Viewer • Updated • 73.8k • 4 • 1 -
trl-internal-testing/Anthropic-hh-rlhf-processed
Viewer • Updated • 3k • 46 -
stojchet/dpo-base_py_java
Viewer • Updated • 17.5k • 3 -
YYYYYYibo/ultrafeedback_binarized_rank4_all_vllm_part_3_mini_0
Viewer • Updated • 5.08k • 2 -
arcee-ai/general-dpo-datasets
Viewer • Updated • 91.6k • 7 -
zaddyzaddy/randomcrawl
Viewer • Updated • 100k • 2 -
lca0503/ultrafeedback-binarized-preferences-cleaned
Viewer • Updated • 60.9k • 2 -
Windy/ultr4_v3_t1_ont0data
Viewer • Updated • 44.9k • 2 -
abhayesian/circuit-breakers-dataset
Viewer • Updated • 4.48k • 112 -
YYYYYYibo/ultrafeedback_binarized_dataset_offline_pairrm_part1
Viewer • Updated • 19.6k • 2 -
JamesSpray/dpo_dataset_hh
Viewer • Updated • 24.2k • 2 -
iamnguyen/orpo-dpo-mix-translated
Viewer • Updated • 44.2k • 1 -
We-Want-GPU/Yi-Ko-DPO-dataset
Viewer • Updated • 4k • 8 • 4 -
lamhieu/itorca_dpo_vi
Viewer • Updated • 12.9k • 4 -
lamhieu/beyond_dpo_vi
Viewer • Updated • 25k • 4 -
arham6/dataset3
Viewer • Updated • 258 • 2 -
gabjp/PKU-safe-dpo
Viewer • Updated • 75.1k • 159 -
Windy/tmp_output
Viewer • Updated • 60 -
abacusai/ARC_DPO_FewShot
Viewer • Updated • 4.25k • 7 • 17 -
alexredna/oasst2_dpo_pairs
Viewer • Updated • 10k • 4 • 6 -
YYYYYYibo/ultrafeedback_binarized_ave_pi_train_part_2
Viewer • Updated • 20k • 2 -
2A2I/Aya-Command.R-DPO
Viewer • Updated • 14.2k • 11 • 7 -
kaist-ai/Multifaceted-Collection-ORPO
Viewer • Updated • 64.6k • 2 • 8 -
mii-community/ultrafeedback-preferences-translated-ita
Viewer • Updated • 60.9k • 2 • 3 -
orpo-explorers/OpenHermesPreferences-10k
Viewer • Updated • 10k • 90 • 2 -
BarraHome/ultrafeedback_binarized
Viewer • Updated • 187k • 16 -
when2rl/py-dpo-v0.1_reformatted
Viewer • Updated • 9.47k • 2 -
when2rl/Nectar_reformatted
Viewer • Updated • 183k • 2 -
ContextualAI/ultrabin_clean_max_chosen_min_rejected_rationalized_truthfulness
Viewer • Updated • 60.9k • 2 -
YYYYYYibo/ultrafeedback_binarized_ave_pi_minpi_part_3
Viewer • Updated • 21.1k • 2 -
YYYYYYibo/ultrafeedback_binarized_ave_pi_with_golden_train_part_2
Viewer • Updated • 20k • 2 -
efederici/alpaca-vs-alpaca-orpo-dpo
Viewer • Updated • 49.2k • 8 • 6 -
IlyaGusev/saiga_preferences
Viewer • Updated • 18.9k • 35 • 3 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_160m_bo16_2_mix_50_kl_0.1_prm_160m_thr_1.0_seed_3
Viewer • Updated • 568k • 2 -
lightblue/mitsu_top75_borda
Viewer • Updated • 2.02k • 2 -
thesven/pihkal-tihkal-orpo-dpo-dataset
Viewer • Updated • 3.46k • 2 -
ContextualAI/ultrabin_clean_max_chosen_min_rejected_rationalized_honesty
Viewer • Updated • 60.9k • 2 -
mintaeng/dpo_ko_mj
Viewer • Updated • 3k • 2 -
AlexHung29629/stack-exchange-paired-128K
Viewer • Updated • 128k • 4 • 1 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_160m_bo16_2_mix_50_kl_0.1_prm_160m_thr_0.0_seed_2
Viewer • Updated • 568k • 2 -
YYYYYYibo/ultrafeedback_binarized_rank4_all_vllm_part_3_mini_2
Viewer • Updated • 5.08k • 2 -
YYYYYYibo/ultrafeedback_binarized_rank4_all_vllm_part_3_mini_3
Viewer • Updated • 5.09k • 2 -
when2rl/UltraInteract_pair_reformatted_filtered
Viewer • Updated • 166k • 2 -
ineskoder/KIBRAM_dataset
Viewer • Updated • 72.2k • 2 -
wisenut-nlp-team/dpo_test2
Viewer • Updated • 100 • 5 -
YYYYYYibo/full_simple_online_train_part_2
Viewer • Updated • 19k • 2 -
YYYYYYibo/full_simple_online_train_part_3
Viewer • Updated • 19.3k • 2 -
YYYYYYibo/gshf_vllm_1_part_2
Viewer • Updated • 20k • 2 -
YYYYYYibo/gshf_vllm_2_part_2
Viewer • Updated • 20k • 2 -
YYYYYYibo/gshf_train_part_2
Viewer • Updated • 20k • 10 -
YYYYYYibo/gshf_vllm_2_part_3
Viewer • Updated • 21.1k • 2 -
RedaAlami/PKU-SafeRLHF-Processed-Modified
Viewer • Updated • 47.1k • 2 -
lightblue/mitsu_tophalf_borda
Viewer • Updated • 1.42k • 2 • 5 -
2A2I/Aya-SambaLingo.Arabic.Chat-DPO
Viewer • Updated • 14.2k • 2 • 3 -
Deojoandco/reward_model_anthropic
Viewer • Updated • 169k • 2 -
vwxyzjn/openhermes-dev__mistralai_Mixtral-8x7B-Instruct-v0.1__1706887192
Viewer • Updated • 405 • 2 -
ShenaoZhang/0.0_4iters_bs256_nodpo_only4w_dataset
Viewer • Updated • 24k • 2 -
YYYYYYibo/eval-dataset-nash
Viewer • Updated • 1k • 2 -
YYYYYYibo/ultrafeedback_binarized_dataset_offline_pairrm_part0
Viewer • Updated • 19.6k • 4 -
ShenaoZhang/0.0_zephyr_5551_4iters_bs256_dataset
Viewer • Updated • 2k • 2 -
aidoko/binarized-nectar
Viewer • Updated • 183k • 2 -
YYYYYYibo/ultrafeedback_binarized_simple_online_vllm_part_1_mini_3
Viewer • Updated • 5k • 2 -
YYYYYYibo/ultrafeedback_binarized_simple_online_vllm_part_3_mini_0
Viewer • Updated • 5.28k • 2 -
YYYYYYibo/ultrafeedback_binarized_simple_online_vllm_part_3
Viewer • Updated • 21.1k • 2 -
justinphan3110/toxic-dpo-v0.2-sft
Viewer • Updated • 540 • 2 -
YYYYYYibo/ultrafeedback_binarized_ave_pi_with_golden_train_part_2_mini_0
Viewer • Updated • 5k • 2 -
We-Want-GPU/Yi-Ko-DPO-Orca-DPO-Pairs
Viewer • Updated • 12.7k • 6 • 5 -
ibivibiv/cleaned_orca_math_dpo_pairs
Viewer • Updated • 200k • 2 • 1 -
alvarobartt/ultrafeedback-multi-binarized-quality-preferences-cleaned
Viewer • Updated • 155k • 4 -
jan-hq/ultrafeedback_quality_binarized
Viewer • Updated • 155k • 4 -
Asap7772/ultrafeedback_binarized_relabelled_ultrarm
Viewer • Updated • 63.1k • 4 -
weijie210/UFB_prefs_iter_0
Viewer • Updated • 24.9k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_160m_bo16_2_mix_50_kl_0.1_prm_160m_thr_0.1_seed_2
Viewer • Updated • 568k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_1.4b_bo16_2_64_mix_50_kl_0.1_prm_410m_thr_0.3_seed_1
Viewer • Updated • 189k • 2 -
YYYYYYibo/ultrafeedback_binarized_epoch_2_minpi_part_3
Viewer • Updated • 5k • 2 -
YYYYYYibo/ultrafeedback_binarized_rank4_all_vllm_part_3_mini_1
Viewer • Updated • 5.28k • 2 -
ShenaoZ/0.0005_withdpo_4iters_bs256_555lr_dataset
Viewer • Updated • 51.8k • 2 -
Baidicoot/hh-rlhf-harmful-responses
Viewer • Updated • 14.9k • 2 -
YYYYYYibo/ultrafeedback_binarized_dataset_offline_pairrm_part2_mini_1
Viewer • Updated • 5.18k • 2 -
YYYYYYibo/ultrafeedback_binarized_rank4_on_vanilla_part_3
Viewer • Updated • 21.1k • 2 -
ibivibiv/cleaned_math_dpo_pairs
Viewer • Updated • 760k • 2 -
YYYYYYibo/ultrafeedback_binarized_simple_online_train_part_3
Viewer • Updated • 21.1k • 2 -
YYYYYYibo/ultrafeedback_binarized_ave_pi_vllm_part_2_mini_3
Viewer • Updated • 5k • 2 -
YYYYYYibo/ultrafeedback_binarized_ave_pi_train_part_2_mini_3
Viewer • Updated • 5k • 2 -
wenzhy7/llama2_orpo_ei
Viewer • Updated • 2.05k • 2 -
abacusai/HellaSwag_DPO_FewShot
Viewer • Updated • 150k • 5 • 8 -
reshinthadith/pairwise-code-review-instruct-critique-revision-python
Viewer • Updated • 5.24k • 2 • 6 -
argilla/ultrafeedback-multi-binarized-quality-preferences-cleaned
Viewer • Updated • 155k • 36 • 4 -
orpo-explorers/ultrafeedback_binarized_15k
Viewer • Updated • 15.4k • 2 • 4 -
ThWu/dpo_highest_n_random
Viewer • Updated • 182k • 4 • 2 -
agicorp/MetaMath_DPO_FewShot
Viewer • Updated • 395k • 2 • 2 -
2A2I/Aya-AceGPT.13B.Chat-DPO
Viewer • Updated • 13k • 2 • 2 -
Trelis/orpo-dpo-mix-40k-SHORT
Viewer • Updated • 7.19k • 2 • 2 -
AlekseyKorshuk/cup-it-ds-pairwise
Viewer • Updated • 352k • 2 -
Code-Refinement/utf_20_refs_pairs
Viewer • Updated • 3.68k • 2 -
when2rl/distilabel-intel-orca-dpo-pairs_cleaned_reformatted
Viewer • Updated • 12.8k • 2 -
reciprocate/dpo_ultra-capybara_filtered-best
Viewer • Updated • 25.6k • 2 -
reciprocate/dpo_ultra-capybara-code_filtered-best
Viewer • Updated • 35.2k • 2 -
ShenaoZ/0.0_dataup_4iters_dataset
Viewer • Updated • 51.8k • 2 -
YYYYYYibo/ultrafeedback_binarized_phase_2_ranked
Viewer • Updated • 9.28k • 2 -
YYYYYYibo/eval-dataset-vanilla
Viewer • Updated • 200 • 2 -
YYYYYYibo/ultrafeedback_binarized_plus_vllm_part_3
Viewer • Updated • 5k • 2 -
vipinkatara/dataset_complete_12
Viewer • Updated • 220k • 2 -
YYYYYYibo/ultrafeedback_binarized_epoch_2_minpi_part_1
Viewer • Updated • 5k • 2 -
YYYYYYibo/ultrafeedback_binarized_rank4_all_vllm_part_2_mini_0
Viewer • Updated • 4.8k • 2 -
ShenaoZ/0.00001_withdpo_4iters_bs256_555lr_dataset
Viewer • Updated • 51.8k • 2 -
YYYYYYibo/ultrafeedback_binarized_dataset_offline_part1
Viewer • Updated • 19.6k • 2 -
YYYYYYibo/ultrafeedback_binarized_dataset_offline_pairrm_part2
Viewer • Updated • 20.7k • 2 -
YYYYYYibo/ultrafeedback_binarized_doff_no_golden_minpi_part_2
Viewer • Updated • 19.1k • 2 -
YYYYYYibo/ultrafeedback_binarized_doff_real_no_golden_minpi_part_2
Viewer • Updated • 19.4k • 2 -
YYYYYYibo/ultrafeedback_binarized_doff_real_no_golden_train_part_2_mini_3
Viewer • Updated • 4.85k • 2 -
when2rl/PKU-SafeRLHF_reformatted_filtered
Viewer • Updated • 136k • 2 -
nhyha/ORPO-DPO
Viewer • Updated • 1.68k • 2 -
YYYYYYibo/ultrafeedback_binarized_ave_pi_train_part_2_mini_0
Viewer • Updated • 5k • 2 -
YYYYYYibo/ultrafeedback_binarized_ave_pi_with_golden_vllm_part_2_mini_3
Viewer • Updated • 5k • 2 -
YYYYYYibo/ultrafeedback_binarized_ave_pi_with_golden_vllm_part_2_mini_0
Viewer • Updated • 5k • 2 -
YYYYYYibo/ultrafeedback_binarized_ave_pi_with_golden_train_part_3_mini_0
Viewer • Updated • 5.28k • 2 -
cmcmaster/clinical_cases_preferences
Viewer • Updated • 7.94k • 2 -
valerielucro/gsm8k_preference_dataset_2.1
Viewer • Updated • 1.21k • 2 -
quyanh/lexglue-cot-dpo
Viewer • Updated • 4k • 2 -
NickyNicky/function_call_orpo_sft_phi3_chatML_only
Viewer • Updated • 66k • 2 • 2 -
2A2I/Aya-Aya.23.8B-DPO
Viewer • Updated • 14k • 2 • 2 -
d0rj/oasst1_pairwise_rlhf_reward-ru
Viewer • Updated • 18.9k • 2 • 1 -
SUSTech/bagel-dpo
Viewer • Updated • 192k • 2 • 1 -
giux78/20000-50000-ultrafeedback-binarized-preferences-cleaned-ita
Viewer • Updated • 30k • 4 -
Astris/Nectar-Ranked-DPO
Viewer • Updated • 503k • 2 -
ShenaoZhang/0.0005_idpo_same_nodpo_replace_dataset
Viewer • Updated • 67.1k • 2 -
ShenaoZ/0.0001_idpo_same_6iters_dataset
Viewer • Updated • 48.8k • 2 -
trl-lib/capybara-preferencces-7k
Viewer • Updated • 7.56k • 2 -
ShenaoZ/0.001_ablation_5iters_bs256_dataset
Viewer • Updated • 56.9k • 2 -
YYYYYYibo/ultrafeedback_binarized_phase_2_part_1minipart_0
Viewer • Updated • 1k • 2 -
YYYYYYibo/first-eval-dataset-no-score
Viewer • Updated • 1k • 3 -
YYYYYYibo/ultrafeedback_binarized_vllm_part_3
Viewer • Updated • 5k • 2 -
YYYYYYibo/ultrafeedback_binarized_train_part_3
Viewer • Updated • 26.1k • 2 -
four-two-labs/orpo-test
Viewer • Updated • 60.9k • 2 -
YYYYYYibo/ultrafeedback_binarized_plus_train_part_3
Viewer • Updated • 5k • 2 -
vipinkatara/dataset_complete_1
Viewer • Updated • 63.1k • 2 -
YYYYYYibo/ultrafeedback_binarized_epoch_2_vllm_part_1
Viewer • Updated • 5k • 2 -
YYYYYYibo/ultrafeedback_binarized_epoch_2_train_part_1
Viewer • Updated • 25k • 2 -
YYYYYYibo/ultrafeedback_binarized_rank4_all_vllm_part_2_mini_3
Viewer • Updated • 5k • 2 -
ShenaoZ/0.0001_withdpo_4iters_bs256_4444lr_dataset
Viewer • Updated • 51.8k • 2 -
YYYYYYibo/ultrafeedback_binarized_new_gen_part_3
Viewer • Updated • 5k • 2 -
YYYYYYibo/ultrafeedback_binarized_dataset_offline_pairrm_part2_mini_3
Viewer • Updated • 5.19k • 4 -
ShenaoZ/0.0001_sft_nodpo_3iters_bs256_531lr_dataset
Viewer • Updated • 67.1k • 2 -
YYYYYYibo/ultrafeedback_binarized_doff_no_golden_train_part_2_mini_0
Viewer • Updated • 4.78k • 2 -
YYYYYYibo/ultrafeedback_binarized_doff_no_golden_minpi_part_3
Viewer • Updated • 20.7k • 2 -
YYYYYYibo/ultrafeedback_binarized_doff_real_no_golden_train_part_3_mini_0
Viewer • Updated • 5.16k • 2 -
arcee-ai/ultrafeedback-binarized
Viewer • Updated • 60.9k • 2 -
YYYYYYibo/ultrafeedback_binarized_simple_online_vllm_part_2_mini_3
Viewer • Updated • 5k • 2 -
YYYYYYibo/ultrafeedback_binarized_simple_online_vllm_part_2
Viewer • Updated • 20k • 2 -
2A2I/NoRobots-Command.R-DPO
Viewer • Updated • 9.5k • 2 -
YYYYYYibo/ultrafeedback_binarized_ave_pi_vllm_part_3_mini_0
Viewer • Updated • 5.28k • 2 -
YYYYYYibo/ultrafeedback_binarized_ave_pi_train_part_3_mini_0
Viewer • Updated • 5.28k • 2 -
YYYYYYibo/ultrafeedback_binarized_ave_pi_with_golden_vllm_part_3_mini_0
Viewer • Updated • 5.28k • 2 -
YYYYYYibo/ultrafeedback_binarized_imp_sam_minpi_part_2
Viewer • Updated • 19.1k • 2 -
kaitchup/UltraFeedback-prompt-chosen-rejected
Viewer • Updated • 18k • 5 • 6 -
reciprocate/math_dpo_pairs
Viewer • Updated • 4.38k • 9 • 5 -
HuggingFaceH4/cai-conversation
Viewer • Updated • 169k • 4 • 3 -
We-Want-GPU/Yi-Ko-DPO-Orca-DPO-Pairs-lora
Viewer • Updated • 6k • 4 • 2 -
vicgalle/OpenHermesPreferences-roleplay
Viewer • Updated • 3.06k • 2 • 3 -
ZHLiu627/ultrafeedback_binarized_with_response_full_part1
Viewer • Updated • 20k • 2 • 1 -
Baidicoot/hh-rlhf-golden-harmful
Viewer • Updated • 7.64k • 2 • 1 -
ummagumm-a/cup-it-ds-classification-pairwise
Viewer • Updated • 282k • 2 -
pszemraj/SHP-2-dpo-100k_sample
Viewer • Updated • 200k • 6 • 1 -
floleuerer/distilabel-intel-orca-dpo-pairs-binarized
Viewer • Updated • 5.92k • 41 -
giux78/0-10000-ultrafeedback-binarized-preferences-cleaned-ita
Viewer • Updated • 10k • 4 -
weijie210/UFB_preference_iter_0_all
Viewer • Updated • 56.6k • 2 -
celinelee/thestack_py312_fstrings_dpo
Viewer • Updated • 100k • 2 -
manishiitg/aditi-dpo-prompts
Viewer • Updated • 48.7k • 2 -
mesolitica/DPO-translated-CodeUltraFeedback
Viewer • Updated • 7.17k • 2 -
ShenaoZ/0.001_ablation_4iters_bs256_decalpha_dataset
Viewer • Updated • 51.8k • 2 -
YYYYYYibo/ultrafeedback_binarized_with_response_full_labeled_part_2
Viewer • Updated • 10k • 2 -
ShenaoZ/0.001_3iters_bs128_declr_nodpo_zephyrbeta_userresponse_dataset
Viewer • Updated • 67.1k • 2 -
ShenaoZ/0.001_ablation_4iters_bs256_only2third_dataset
Viewer • Updated • 2k • 2 -
YYYYYYibo/ultrafeedback_binarized_phase_1_part_1_part0
Viewer • Updated • 5k • 2 -
YYYYYYibo/ultrafeedback_binarized_phase_1_part_1_minpi
Viewer • Updated • 10k • 4 -
YYYYYYibo/ultrafeedback_binarized_phase_2
Viewer • Updated • 20k • 2 -
YYYYYYibo/ultrafeedback_binarized_phase_2_part_1minipart_2
Viewer • Updated • 1k • 2 -
YYYYYYibo/ultrafeedback_binarized_phase_2_unranked
Viewer • Updated • 9.28k • 2 -
YYYYYYibo/ultrafeedback_binarized_phase_2_minpi
Viewer • Updated • 9.28k • 2 -
YYYYYYibo/ultrafeedback_binarized_train_part_2
Viewer • Updated • 25k • 2 -
GENIAC-Team-Ozaki/chatbot-arena-ja-calm2-7b-chat-experimental_deduped
Viewer • Updated • 23.3k • 2 -
YYYYYYibo/eval-dataset-rank4
Viewer • Updated • 200 • 2 -
YYYYYYibo/ultrafeedback_binarized_epoch_2_train_part_3
Viewer • Updated • 26.1k • 2 -
YYYYYYibo/ultrafeedback_binarized_rank4_all_train_part_2
Viewer • Updated • 18.6k • 2 -
YYYYYYibo/ultrafeedback_binarized_rank4_all_minpi_part_3
Viewer • Updated • 20.5k • 2 -
ShenaoZ/0.00005_withdpo_4iters_bs256_555lr_dataset
Viewer • Updated • 51.8k • 2 -
YYYYYYibo/ultrafeedback_binarized_new_train_part_2
Viewer • Updated • 15k • 2 -
YYYYYYibo/ultrafeedback_binarized_dataset_offline_pairrm_part2_mini_0
Viewer • Updated • 5.18k • 2 -
YYYYYYibo/ultrafeedback_binarized_doff_no_golden_vllm_part_2_mini_3
Viewer • Updated • 5k • 2 -
YYYYYYibo/ultrafeedback_binarized_doff_no_golden_vllm_part_2_mini_0
Viewer • Updated • 5k • 2 -
YYYYYYibo/ultrafeedback_binarized_doff_no_golden_vllm_part_3_mini_0
Viewer • Updated • 5.28k • 2 -
YYYYYYibo/ultrafeedback_binarized_doff_no_golden_train_part_3_mini_0
Viewer • Updated • 5.18k • 2 -
YYYYYYibo/ultrafeedback_binarized_doff_real_no_golden_vllm_part_2_mini_0
Viewer • Updated • 5k • 2 -
YYYYYYibo/ultrafeedback_binarized_doff_real_no_golden_train_part_2
Viewer • Updated • 19.4k • 2 -
YYYYYYibo/ultrafeedback_binarized_doff_real_no_golden_vllm_part_3_mini_0
Viewer • Updated • 5.28k • 2 -
YYYYYYibo/ultrafeedback_binarized_doff_real_no_golden_minpi_part_3
Viewer • Updated • 20.6k • 2 -
YYYYYYibo/ultrafeedback_binarized_doff_real_no_golden_train_part_3
Viewer • Updated • 20.6k • 2 -
ibivibiv/nectar_dpo_cleaned
Viewer • Updated • 3.84M • 2 -
euiyulsong/sci_train_ds
Viewer • Updated • 11.7k • 2 -
ibivibiv/cleaned_math_dpo_pairs_eval
Viewer • Updated • 40k • 2 -
YYYYYYibo/ultrafeedback_binarized_simple_online_train_part_3_mini_0
Viewer • Updated • 5.28k • 2 -
YYYYYYibo/ultrafeedback_binarized_simple_online_train_part_3_mini_1
Viewer • Updated • 5.28k • 2 -
mnlp-nsoai/dpo-student-preference-pairs
Viewer • Updated • 18.4k • 2 -
arham6/dataset2
Viewer • Updated • 258 • 2 -
aklein4/tldr-feedback-shuffled
Viewer • Updated • 179k • 2 -
fblgit/simple-math-DPO
Viewer • Updated • 800k • 31 • 13 -
malhajar/orca_dpo_pairs-tr
Viewer • Updated • 10.8k • 4 • 5 -
IlyaGusev/saiga_reward
Viewer • Updated • 27k • 13 • 4 -
PawanKrd/dpo-gpt-4o
Viewer • Updated • 12.4k • 13 • 10 -
NickyNicky/oasst2_orpo_mix_function_call_phi_3_v1
Viewer • Updated • 120k • 2 • 2 -
d0rj/full-hh-rlhf-ru
Viewer • Updated • 125k • 107 • 2 -
lightblue/mitsu_full_borda
Viewer • Updated • 2.85k • 29 • 2 -
vwxyzjn/openhermes-dev__mistralai_Mixtral-8x7B-Instruct-v0.1__1707245027
Viewer • Updated • 1M • 2 -
when2rl/distilabel-capybara-dpo-7k-binarized_reformatted
Viewer • Updated • 7.56k • 2 -
0-hero/distilabel-math-preference-dpo
Viewer • Updated • 2.42k • 6 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_1.4b_bo2_100_kl_0.1_prm_160m_thr_1.0_seed_2
Viewer • Updated • 189k • 2 -
Mitsuki-Sakamoto/alfa-deberta-re-pref-64-fil_self_1.4b_bo16_2_64_mix_50_kl_0.1_prm_160m_thr_0.0_seed_2_t_1.0
Viewer • Updated • 94.6k • 2 -
ShenaoZhang/0.001_idpo_ref_response
Viewer • Updated • 44.8k • 2 -
ShenaoZhang/0.001_idpo_same_replacechosen_only_dataset
Viewer • Updated • 44.8k • 2 -
when2rl/prm_dpo_pairs_cleaned_reformatted
Viewer • Updated • 7.99k • 2 -
YYYYYYibo/ultrafeedback_binarized_with_response_full_labeled_part_4
Viewer • Updated • 10k • 2 -
cornfieldrm/prm800k-phase2
Viewer • Updated • 81.6k • 2 -
YYYYYYibo/ultrafeedback_binarized_phase_3
Viewer • Updated • 21.1k • 2 -
YYYYYYibo/ultrafeedback_binarized_minpi_part_3
Viewer • Updated • 5k • 2 -
ShenaoZ/0.00001_withdpo_4iters_bs256_531lr_dataset
Viewer • Updated • 51.8k • 2 -
GENIAC-Team-Ozaki/tuninig-dataset_pref_20pct_lora-sft-finetuned-stage4-iter86000
Viewer • Updated • 20.8k • 2 -
2A2I/NoRobots-Aya.23.8B-DPO
Viewer • Updated • 9.5k • 2 -
y1xing/orpo_llama3_concatenated_data_with_chris_examples_orpo_instruct_dataset
Viewer • Updated • 2.64k • 2 -
mlabonne/arena-preferences
Viewer • Updated • 2.69k • 3 • 9 -
reciprocate/ultrafeedback_orca_math_cleaned_high_dpo
Viewer • Updated • 48.3k • 4 • 1 -
SUSTech/bagel-sft
Viewer • Updated • 727k • 2 -
vwxyzjn/openhermes-dev__mistralai_Mistral-7B-Instruct-v0.1__1706885528
Viewer • Updated • 24 • 2 -
Sharathhebbar24/orca_dpo_pairs
Viewer • Updated • 12.9k • 3 -
quirky-lats-at-mats/NORMAL_BACKDOOR_alpaca_sleeper_agents_toy_safety_NOT_TRUNCATED_v4
Viewer • Updated • 2.83k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_160m_bo2_100_kl_0.1_prm_70m_thr_0.1_seed_2
Viewer • Updated • 568k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_1.4b_bo16_2_64_mix_50_kl_0.1_prm_410m_thr_0.1_seed_1
Viewer • Updated • 189k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_1.4b_bo16_2_64_mix_50_kl_0.1_prm_160m_thr_1.0_seed_3
Viewer • Updated • 568k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_1.4b_bo2_100_kl_0.1_prm_160m_thr_1.0_seed_1
Viewer • Updated • 189k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_1.4b_bo2_100_kl_0.1_prm_410m_thr_1.0_seed_3
Viewer • Updated • 189k • 2 -
pgurazada1/ultrafeedback-sample
Viewer • Updated • 315 • 35 -
UCLAML/data-RPO-Iter1-New-309_generated
Viewer • Updated • 20k • 2 -
NobodyExistsOnTheInternet/ToxicDPOqa
Viewer • Updated • 6.87k • 14 • 14 -
d0rj/rlhf-reward-datasets-ru
Viewer • Updated • 81.4k • 90 • 4 -
HuggingFaceH4/cai-conversation-harmless-old
Viewer • Updated • 44.8k • 4 • 3 -
allenai/reward-bench-results
Updated • 4 • 2 -
d0rj/synthetic-instruct-gptj-pairwise-ru
Viewer • Updated • 33.1k • 26 • 1 -
banghua/hh_reward_model_labeled
Viewer • Updated • 125k • 2 -
vwxyzjn/ultrafeedback_binarized_1707921333
Viewer • Updated • 2k • 2 -
vwxyzjn/ultrafeedback_binarized_1708458397
Viewer • Updated • 25.3k • 2 -
David-Xu/astronomy-stack-dpo-text-20-percent
Viewer • Updated • 3.99k • 3 • 1 -
abhinand/argilla-dpo-mix-7k-singleturn
Viewer • Updated • 4.9k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_160m_bo2_100_kl_0.1_prm_160m_thr_1.0_seed_3
Viewer • Updated • 568k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_160m_bo2_100_kl_0.1_prm_70m_thr_1.0_seed_2
Viewer • Updated • 568k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_160m_bo2_100_kl_0.1_prm_160m_thr_1.0_seed_2
Viewer • Updated • 568k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_160m_bo2_100_kl_0.1_prm_70m_thr_0.1_seed_3
Viewer • Updated • 568k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.0_seed_3
Viewer • Updated • 568k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_1.4b_bo16_2_64_mix_50_kl_0.1_prm_160m_thr_1.0_seed_1
Viewer • Updated • 189k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_1.4b_bo16_2_64_mix_50_kl_0.1_prm_160m_thr_1.0_seed_2
Viewer • Updated • 511k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_1.4b_bo2_100_kl_0.1_prm_160m_thr_0.3_seed_1
Viewer • Updated • 189k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_1.4b_bo2_100_kl_0.1_prm_410m_thr_0.1_seed_2
Viewer • Updated • 189k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_1.4b_bo2_100_kl_0.1_prm_410m_thr_0.1_seed_3
Viewer • Updated • 189k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_14m_thr_0.0_seed_2_t_1.0
Viewer • Updated • 568k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.0_seed_2_tp_0.5
Viewer • Updated • 568k • 2 -
ShenaoZ/0.001_ablation_4iters_bs256_useresponse_dataset
Viewer • Updated • 17.3k • 2 -
ShenaoZhang/0.0001_4iters_bs256_nodpo_only4w_dataset
Viewer • Updated • 62k • 2 -
communityai/system_identity_remove_preference_qwen-v2
Viewer • Updated • 93 • 2 -
ShenaoZ/0.0001_withdpo_4iters_bs256_511lr_dataset
Viewer • Updated • 51.8k • 2 -
YYYYYYibo/ultrafeedback_binarized_epoch_2_vllm_part_2
Viewer • Updated • 5k • 2 -
YYYYYYibo/ultrafeedback_binarized_doff_real_no_golden_train_part_3_mini_1
Viewer • Updated • 5.16k • 2 -
euiyulsong/generated_data
Viewer • Updated • 452 • 2 -
arcee-ai/truthy-dpo-v0.1-binarized
Viewer • Updated • 1.02k • 2 -
arcee-ai/OpenHermesPreferences-binarized
Viewer • Updated • 989k • 2 • 1 -
arcee-ai/multiturn-capybara-preferences-filtered-binarized
Viewer • Updated • 14.8k • 2 -
YYYYYYibo/ultrafeedback_binarized_simple_online_train_part_1_mini_2
Viewer • Updated • 5k • 2 -
YYYYYYibo/ultrafeedback_binarized_simple_online_train_part_2_mini_1
Viewer • Updated • 5k • 2 -
when2rl/HelpSteer_reformatted
Viewer • Updated • 9.17k • 2 -
YYYYYYibo/ultrafeedback_binarized_ave_pi_vllm_part_3_mini_1
Viewer • Updated • 5.28k • 2 -
YYYYYYibo/full_simple_online_vllm_part_2
Viewer • Updated • 19k • 2 -
YYYYYYibo/full_simple_online_vllm_part_3
Viewer • Updated • 19.3k • 2 -
YYYYYYibo/gshf_vllm_1_part_3
Viewer • Updated • 21.1k • 2 -
YYYYYYibo/gshf_train_part_3
Viewer • Updated • 21.1k • 2 -
BramVanroy/orca_dpo_pairs_dutch
Viewer • Updated • 11k • 4 • 5 -
erhwenkuo/rlhf_reward_single_round-chinese-zhtw
Viewer • Updated • 24.9k • 7 • 3 -
alielfilali01/ultrafeedback-arabic
Viewer • Updated • 63.1k • 2 • 2 -
Palash123/dpo_anthropic_hh_rlhf
Viewer • Updated • 168k • 91 • 1 -
ayoubkirouane/Orca-Direct-Preference-Optimization
Viewer • Updated • 12.9k • 4 • 1 -
winglian/cortex-0_1-loss
Viewer • Updated • 402 • 2 • 1 -
vtiyyal1/AskDocsEmpathy_4k_dpo
Viewer • Updated • 4.12k • 2 • 1 -
ummagumm-a/cup-it-ds-classification-pairwise-test
Viewer • Updated • 56k • 2 -
AlekseyKorshuk/lmeh-hh
Viewer • Updated • 12.5k • 2 -
genta-tech/rlhf-id-30
Viewer • Updated • 125k • 4 -
vwxyzjn/cai-conversation-prod-h4-harmless
Viewer • Updated • 44.9k • 4 -
giux78/10000-20000-ultrafeedback-binarized-preferences-cleaned-ita
Viewer • Updated • 10k • 4 -
giux78/50000-60900-ultrafeedback-binarized-preferences-cleaned-ita
Viewer • Updated • 10.9k • 4 -
vwxyzjn/cai-conversation-dev1705951688
Viewer • Updated • 256 • 4 -
manishiitg/unalignment-toxic-dpo-v0.2
Viewer • Updated • 1.08k • 2 -
remyxai/ffmperative_dpo_test
Viewer • Updated • 1.47k • 2 -
weijie210/UFB_prefs_nosub_iter_0
Viewer • Updated • 14.7k • 2 -
when2rl/UltraFeedback_binarized_cleaned_annotated
Viewer • Updated • 62.7k • 2 -
roleplay4fun/chai-valid-pairs-ss5-v1.0
Viewer • Updated • 12.2k • 2 -
Baidicoot/anthropic_hh_golden_mistral
Viewer • Updated • 42.1k • 2 -
psyche/anthropic-hh-rlhf
Viewer • Updated • 169k • 2 -
aengusl/noise5_alpaca_sleeper_agents_toy_safety_v4
Viewer • Updated • 2.83k • 2 -
vtiyyal1/AskDocsEmpathy_2k_llama_dpo
Viewer • Updated • 2.12k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_160m_bo2_100_kl_0.1_prm_70m_thr_0.3_seed_2
Viewer • Updated • 568k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_1.4b_bo2_100_kl_0.1_prm_160m_thr_0.1_seed_3
Viewer • Updated • 189k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_1.4b_bo2_100_kl_0.1_prm_160m_thr_0.1_seed_2
Viewer • Updated • 189k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_1.4b_bo2_100_kl_0.1_prm_160m_thr_1.0_seed_3
Viewer • Updated • 189k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_1.4b_bo2_100_kl_0.1_prm_410m_thr_0.3_seed_3
Viewer • Updated • 189k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.3_seed_1_t_1.0
Viewer • Updated • 568k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.5_seed_3_t_1.0
Viewer • Updated • 568k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_1.0_seed_3_t_1.0
Viewer • Updated • 568k • 2 -
Mitsuki-Sakamoto/alfa-deberta-re-pref-64-fil_self_1.4b_bo16_2_64_mix_50_kl_0.1_prm_160m_thr_0.0_seed_3_t_1.0
Viewer • Updated • 94.6k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.0_seed_1_t_0.5
Viewer • Updated • 568k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.0_seed_1_t_0.25
Viewer • Updated • 568k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.0_seed_1_tp_0.7
Viewer • Updated • 568k • 2 -
ShenaoZ/0.0001_idpo_same_3iters_dataset
Viewer • Updated • 44.8k • 2 -
ShenaoZ/0.0001_idpo_same_3itersn_dataset
Viewer • Updated • 44.8k • 2 -
ShenaoZ/0.001_ablation_4iters_dataset
Viewer • Updated • 17.3k • 2 -
ShenaoZ/0.001_ablation_dataset
Viewer • Updated • 44.8k • 2 -
orpo-explorers/OHP-15k-Stratified-3
Viewer • Updated • 15k • 2 -
distilabel-internal-testing/ultrafeedback-mini-dpo
Viewer • Updated • 10 • 2 -
ShenaoZ/0.001_ablation_3iters_bs256_nodpo_dataset
Viewer • Updated • 67.1k • 2 -
ShenaoZhang/0.0_ablation_4iters_bs128_nodpo_dataset
Viewer • Updated • 53.8k • 2 -
ShenaoZ/0.001_4iters_bs128_declr_nodpo_useresponse_dataset
Viewer • Updated • 69.1k • 2 -
ShenaoZ/0.001_3iters_bs128_declr_nodpo_dataset
Viewer • Updated • 24.4k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.0_seed_4
Viewer • Updated • 303k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo2_100_kl_0.1_prm_70m_thr_0.0_seed_4
Viewer • Updated • 303k • 2 -
ShenaoZhang/0.001_4iters_bs256_nodpo_only4w_zephyr_dataset
Viewer • Updated • 48k • 2 -
communityai/mlabonne___orpo-dpo-mix-40k
Viewer • Updated • 44.2k • 2 -
communityai/system_identity_remove_preference_qwen_1.5-v2
Viewer • Updated • 93 • 2 -
theGhoul21/dpo-dataset-v2
Viewer • Updated • 4.83k • 2 -
ShenaoZ/0.0_withdpo_4iters_bs256_531lr_dataset
Viewer • Updated • 51.8k • 2 -
theGhoul21/irpo-dataset-v1
Viewer • Updated • 11k • 2 -
YYYYYYibo/eval-dataset-with-score-nash
Viewer • Updated • 200 • 2 -
YYYYYYibo/eval-dataset-with-score-rank4
Viewer • Updated • 200 • 2 -
YYYYYYibo/ultrafeedback_binarized_rank4_all_vllm_part_2_mini_1
Viewer • Updated • 5k • 2 -
ShenaoZ/0.0_withdpo_4iters_bs256_5102lr_dataset
Viewer • Updated • 51.8k • 2 -
ShenaoZ/0.0001_withdpo_4iters_bs256_3333lr_dataset
Viewer • Updated • 51.8k • 2 -
ShenaoZ/0.0001_zephyrdpoinit_nodpo_3iters_bs256_555lr_dataset
Viewer • Updated • 67.1k • 2 -
ashishkgpian/kaggle_comp_dpo
Viewer • Updated • 39.7k • 2 -
YYYYYYibo/ultrafeedback_binarized_dataset_offline_pairrm_part1_mini_3
Viewer • Updated • 4.9k • 2 -
Baidicoot/helpful-harmful-rlhf
Viewer • Updated • 161k • 2 -
massimilianowosz/japanese_food
Viewer • Updated • 4.69k • 2 -
YYYYYYibo/ultrafeedback_binarized_doff_no_golden_vllm_part_3_mini_3
Viewer • Updated • 5.09k • 2 -
YYYYYYibo/ultrafeedback_binarized_doff_no_golden_vllm_part_3_mini_1
Viewer • Updated • 5.28k • 2 -
YYYYYYibo/ultrafeedback_binarized_doff_real_no_golden_vllm_part_2_mini_2
Viewer • Updated • 4.4k • 2 -
YYYYYYibo/ultrafeedback_binarized_doff_real_no_golden_train_part_2_mini_2
Viewer • Updated • 4.85k • 2 -
YYYYYYibo/ultrafeedback_binarized_doff_real_no_golden_train_part_2_mini_1
Viewer • Updated • 4.85k • 2 -
when2rl/hh-rlhf_reformatted
Viewer • Updated • 169k • 2 -
ShenaoZ/0.001_withdpo_4iters_bs256_5551lr_dataset
Viewer • Updated • 51.8k • 2 -
Baidicoot/anthropic-rlhf-eval
Viewer • Updated • 2.31k • 2 -
euiyulsong/arc_easy
Viewer • Updated • 2.25k • 2 -
Aditya685/dpo_data
Viewer • Updated • 3.15k • 2 -
YYYYYYibo/ultrafeedback_binarized_simple_online_train_part_2_mini_2
Viewer • Updated • 5k • 2 -
YYYYYYibo/ultrafeedback_binarized_simple_online_vllm_part_3_mini_1
Viewer • Updated • 5.28k • 2 -
GENIAC-Team-Ozaki/tuninig-dataset_pref_20pct_v3_full-sft-finetuned-stage4-iter86000-v3
Viewer • Updated • 19.3k • 2 -
2A2I/NoRobots-SambaLingo.Arabic.Chat-DPO
Viewer • Updated • 9.5k • 2 -
WKLI22/orpo-dpo-mix-zh-40k
Viewer • Updated • 44.2k • 2 -
d-llm/hh-rlhf
Viewer • Updated • 160k • 2 -
YYYYYYibo/ultrafeedback_binarized_ave_pi_vllm_part_2_mini_2
Viewer • Updated • 5k • 2 -
YYYYYYibo/ultrafeedback_binarized_ave_pi_train_part_3_mini_1
Viewer • Updated • 5.28k • 2 -
YYYYYYibo/ultrafeedback_binarized_ave_pi_train_part_3_mini_2
Viewer • Updated • 5.28k • 2 -
YYYYYYibo/ultrafeedback_binarized_ave_pi_with_golden_minpi_part_2
Viewer • Updated • 20k • 2 -
YYYYYYibo/ultrafeedback_binarized_ave_pi_with_golden_train_part_3
Viewer • Updated • 21.1k • 2 -
vicgalle/configurable-system-prompt-multitask
Viewer • Updated • 1.95k • 31 • 19 -
Dahoas/rm_instruct_helpful_preferences
Viewer • Updated • 90.7k • 2 • 4 -
Dahoas/instruct_helpful_preferences
Viewer • Updated • 111k • 2 • 1 -
eryk-mazus/polka-dpo-v1
Viewer • Updated • 7.06k • 2 • 1 -
Baidicoot/harmful-rlhf
Viewer • Updated • 42.5k • 3 • 1 -
AlekseyKorshuk/davinci-pairwise-medium
Viewer • Updated • 72k • 2 -
AlekseyKorshuk/cup-it-ds-pairwise-small
Viewer • Updated • 17.6k • 2 -
TaylorAI/rlcd
Viewer • Updated • 168k • 4 -
abhishek/dpo-sample
Viewer • Updated • 7 • 8 -
orendar/ultrafeedback_binarized_filtered
Viewer • Updated • 27.2k • 56 -
varun-v-rao/mimic_cxr_dpo
Viewer • Updated • 125k • 4 -
dvilasuero/ultrafeedback-followup
Viewer • Updated • 6k • 4 • 1 -
dvilasuero/multiturn_with_generations
Viewer • Updated • 100 • 4 -
reciprocate/pku_safer_dpo_pairs
Viewer • Updated • 51.8k • 4 -
vwxyzjn/cai-conversation-dev1705525723
Viewer • Updated • 256 • 4 -
CognitiveLab/hh-rlhf-formatted-60000
Viewer • Updated • 60k • 4 -
vwxyzjn/cai-conversation-dev1705633234
Viewer • Updated • 256 • 4 -
vwxyzjn/self-reward-dev1706043619
Viewer • Updated • 16 • 4 -
vwxyzjn/self-reward-dev1706112590
Viewer • Updated • 16 • 4 -
SUSTech/bagel-clean
Viewer • Updated • 799k • 2 -
Asap7772/ultrafeedback_binarized_narrow
Viewer • Updated • 60.7k • 2 -
dkshjn/processed_truthy-v2
Viewer • Updated • 1.02k • 2 -
weijie210/UC_prefs_nosub_iter_0
Viewer • Updated • 14.4k • 2 -
nz/highest-number-rlhf
Viewer • Updated • 84k • 2 -
weijie210/gsm8k_dpo
Viewer • Updated • 5.48k • 4 -
nz/100_rlhf
Viewer • Updated • 107k • 2 -
vwxyzjn/ultrafeedback_binarized_1707920039
Viewer • Updated • 2k • 2 -
macadeliccc/distilabel-neurology-preferences-2k-cleaner
Viewer • Updated • 1.99k • 2 -
cassanof/python_pass_fail_sample
Viewer • Updated • 100 • 2 -
NickyNicky/distilabel-intel-orca-dpo-pairs_gemma_chatml
Viewer • Updated • 12.9k • 2 -
jikaixuan/mistral02_generated
Viewer • Updated • 61.1k • 2 -
Baidicoot/anthropic_hh_golden_llama
Viewer • Updated • 42.1k • 1 -
arianhosseini/summ_dpo1b1_ngen10_minmax
Viewer • Updated • 20k • 2 -
nz/closest_to_7000_range_1000_to_9000
Viewer • Updated • 11k • 2 -
David-Xu/astronomy-stack-cira
Viewer • Updated • 19.9k • 3 -
boopysaur/user2-dpo-small
Updated • 1 -
David-Xu/astronomy-stack-dpo-20-percent
Viewer • Updated • 3.99k • 1 -
aengusl/test_hp_dpo_unlrn_ds
Viewer • Updated • 312 • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-preference-64-nsample-2_filter_gold_thr_0.2_self_70m
Viewer • Updated • 37.9k • 2 -
valerielucro/Preference-Dataset-sample
Viewer • Updated • 525 • 2 -
mesolitica/DPO-malaysian-questions
Viewer • Updated • 32.5k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_160m_bo2_100_kl_0.1_prm_70m_thr_1.0_seed_1
Viewer • Updated • 568k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_160m_bo16_2_mix_50_kl_0.1_prm_160m_thr_0.1_seed_1
Viewer • Updated • 568k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_1.4b_bo16_2_64_mix_50_kl_0.1_prm_160m_thr_0.1_seed_2
Viewer • Updated • 568k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_1.4b_bo16_2_64_mix_50_kl_0.1_prm_410m_thr_0.3_seed_2
Viewer • Updated • 189k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.3_seed_3_t_1.0
Viewer • Updated • 568k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.0_seed_2_t_0.25
Viewer • Updated • 568k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.0_seed_2_t_0.9
Viewer • Updated • 568k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.0_seed_3_t_0.9
Viewer • Updated • 568k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo2_100_kl_0.1_prm_70m_thr_0.0_seed_2_t_1.0
Viewer • Updated • 568k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.0_seed_3_tp_0.3
Viewer • Updated • 568k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.0_seed_3_tp_0.5
Viewer • Updated • 568k • 2 -
Mitsuki-Sakamoto/fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.3_seed_1_t_1.0_eval
Viewer • Updated • 568k • 2 -
ShenaoZ/0.0_dataup_dataset
Viewer • Updated • 44.8k • 2 -
Gopal2002/zephyr-gemma-finetune-dpo
Viewer • Updated • 69 • 2 -
AnushaKulkarni/preferred_dataset
Viewer • Updated • 50 • 2 -
thavens/ufb_mini
Viewer • Updated • 160 • 2 -
guoyu-zhang/hh_llama2
Viewer • Updated • 125k • 2 -
guoyu-zhang/usp_1
Viewer • Updated • 1k • 2 -
ShenaoZ/0.0_ablation_4iters_dataset
Viewer • Updated • 17.3k • 2 -
ShenaoZ/0.000001_ablation_dataset
Viewer • Updated • 44.8k • 4 -
ShenaoZ/0.0001_ablation_4iters_bs256_dataset
Viewer • Updated • 51.8k • 2 -
YYYYYYibo/ultrafeedback_binarized_with_response_full
Viewer • Updated • 61.1k • 2 -
UCLAML/RPO-Iter2-New-312_generated
Viewer • Updated • 20k • 2 -
YYYYYYibo/ultrafeedback_binarized_with_response_full_labeled_part_0
Viewer • Updated • 10k • 2 -
YYYYYYibo/ultrafeedback_binarized_with_response_full_labeled_part_1
Viewer • Updated • 10k • 2 -
YYYYYYibo/ultrafeedback_binarized_with_response_full_labeled_part_3
Viewer • Updated • 10k • 2 -
YYYYYYibo/ultrafeedback_binarized_with_response_full_labeled_part_5
Viewer • Updated • 10k • 2 -
YYYYYYibo/ultrafeedback_binarized_without_ranked
Viewer • Updated • 10k • 2 -
ShenaoZ/0.001_3iters_bs256_declr_nodpo_userresponse_dataset
Viewer • Updated • 67.1k • 2 -
NickyNicky/mlabonne_orpo-dpo-mix-40k
Viewer • Updated • 44.2k • 8 -
lightblue/mitsu_top25_borda
Viewer • Updated • 674 • 8 -
theGhoul21/dpo-dataset
Viewer • Updated • 4.82k • 2 -
communityai/system_identity_remove_preference_microsoft
Viewer • Updated • 93 • 2 -
communityai/system_identity_remove_preference_gpt_5
Viewer • Updated • 93 • 2 -
communityai/system_identity_remove_preference_llama
Viewer • Updated • 93 • 2 -
communityai/system_identity_remove_preference_command
Viewer • Updated • 93 • 2 -
communityai/system_identity_remove_preference_gpt_3-v2
Viewer • Updated • 93 • 2 -
communityai/system_identity_remove_preference_chatgpt-v2
Viewer • Updated • 93 • 2 -
communityai/system_identity_remove_preference_microsoft-v2
Viewer • Updated • 93 • 2 -
communityai/system_identity_remove_preference_meta_ai-v2
Viewer • Updated • 93 • 2 -
ShenaoZhang/0.001_2iters_bs256_nodpo_full6w_dataset
Viewer • Updated • 65.1k • 2 -
YYYYYYibo/first-dpo-eval-dataset-no-score
Viewer • Updated • 1k • 2 -
ShenaoZhang/0.0_3iters_bs256_nodpo_full6w_dataset
Viewer • Updated • 44.8k • 2 -
nnheui/stablelm-2-1_6b-sft-full-ultrafeedback_generated
Viewer • Updated • 61.1k • 2 -
YYYYYYibo/eval-dataset-merge
Viewer • Updated • 1k • 2 -
YYYYYYibo/eval-dataset-with-score-vanilla
Viewer • Updated • 200 • 2 -
YYYYYYibo/ultrafeedback_binarized_plus_left_part_3
Viewer • Updated • 16.1k • 2 -
ShenaoZ/0.0001_withdpo_3iters_bs256_551lr_dataset
Viewer • Updated • 44.8k • 2 -
YYYYYYibo/ultrafeedback_binarized_epoch_2_left_part_1
Viewer • Updated • 16.1k • 2 -
YYYYYYibo/ultrafeedback_binarized_epoch_2_left_part_3
Viewer • Updated • 15k • 2 -
YYYYYYibo/ultrafeedback_binarized_rank4_all_vllm_part_2_mini_2
Viewer • Updated • 3.8k • 2 -
AmberYifan/safetyQA_DPO
Viewer • Updated • 55k • 4 -
ShenaoZ/0.0001_zephyrgemmadpo_nodpo_3iters_bs256_555lr_dataset
Viewer • Updated • 22.4k • 2 -
YYYYYYibo/ultrafeedback_binarized_new_gen_part_1
Viewer • Updated • 5k • 2 -
YYYYYYibo/ultrafeedback_binarized_dataset_offline_pairrm_part0_mini_1
Viewer • Updated • 4.9k • 2 -
YYYYYYibo/ultrafeedback_binarized_dataset_offline_pairrm_part1_mini_1
Viewer • Updated • 4.9k • 2 -
YYYYYYibo/ultrafeedback_binarized_doff_no_golden_train_part_2_mini_1
Viewer • Updated • 4.78k • 2 -
ShenaoZ/0.0001_sft_nodpo_4iters_bs256_5102lr_dataset
Viewer • Updated • 69.1k • 2 -
YYYYYYibo/ultrafeedback_binarized_doff_no_golden_train_part_3_mini_3
Viewer • Updated • 5.19k • 2 -
YYYYYYibo/ultrafeedback_binarized_doff_real_no_golden_vllm_part_3_mini_1
Viewer • Updated • 5.28k • 2 -
ShenaoZ/0.0005_withdpo_4iters_bs256_2epoch_5311lr_dataset
Viewer • Updated • 51.8k • 2 -
ShenaoZhang/0.01_zephyr_5551_4iters_bs256_dataset
Viewer • Updated • 51.8k • 2 -
euiyulsong/threedata
Viewer • Updated • 5.7k • 2 -
euiyulsong/arc_all
Viewer • Updated • 3.36k • 2 -
DuongTrongChi/detoxic
Viewer • Updated • 5.69k • 2 -
euiyulsong/generated_data_all_cos
Viewer • Updated • 3.32k • 2 -
euiyulsong/generated_data_all_cos_1000
Viewer • Updated • 1k • 2 -
arcee-ai/OpenHermes2.5-dpo-binarized-alpha
Viewer • Updated • 9.79k • 2 -
YYYYYYibo/ultrafeedback_binarized_simple_online_vllm_part_1
Viewer • Updated • 20k • 2 -
YYYYYYibo/ultrafeedback_binarized_simple_online_train_part_2
Viewer • Updated • 20k • 2 -
YYYYYYibo/ultrafeedback_binarized_simple_online_vllm_part_3_mini_3
Viewer • Updated • 5.29k • 2 -
YYYYYYibo/ultrafeedback_binarized_simple_online_train_part_3_mini_2
Viewer • Updated • 5.28k • 2 -
mnlp-nsoai/hf-dpo-pairs-collection
Viewer • Updated • 10.5k • 2 -
2A2I/NoRobots-AceGPT.13B.Chat-DPO
Viewer • Updated • 9.5k • 2 -
berquetR/dpo_preference_dataset_EPFL_shp
Viewer • Updated • 69.1k • 2 -
AlpacaAAR/epfl-synthetic-dpo
Viewer • Updated • 19.6k • 2 -
ShenaoZ/SELM-Zephyr-7B-dataset
Viewer • Updated • 17.3k • 2 -
TTTXXX01/My-Zephyr-7B-dataset
Viewer • Updated • 51.8k • 2 -
YYYYYYibo/ultrafeedback_binarized_ave_pi_vllm_part_2_mini_0
Viewer • Updated • 5k • 2 -
YYYYYYibo/ultrafeedback_binarized_ave_pi_vllm_part_2_mini_1
Viewer • Updated • 5k • 2 -
YYYYYYibo/ultrafeedback_binarized_ave_pi_minpi_part_2
Viewer • Updated • 20k • 2 -
YYYYYYibo/ultrafeedback_binarized_ave_pi_train_part_2_mini_1
Viewer • Updated • 5k • 2 -
YYYYYYibo/ultrafeedback_binarized_ave_pi_train_part_3
Viewer • Updated • 21.1k • 2 -
SiMajid/Dahoad
Viewer • Updated • 2.96k • 2 -
YYYYYYibo/ultrafeedback_binarized_ave_pi_with_golden_minpi_part_3
Viewer • Updated • 21.1k • 2 -
valerielucro/gsm8k_preference_dataset_2
Viewer • Updated • 379 • 2 -
Dahoas/static-hh
Viewer • Updated • 101k • 68 • 19 -
M4-ai/prm_dpo_pairs
Viewer • Updated • 93.9k • 2 • 7 -
NickyNicky/neovalle_H4rmony_dpo_translated_English_to_Spanish
Viewer • Updated • 2.02k • 2 • 4 -
Starlento/DPO-En-Zh-20k-handbook
Viewer • Updated • 20k • 2 • 3 -
orpo-explorers/OpenHermesPreferences-500k
Viewer • Updated • 500k • 2 • 2 -
vwxyzjn/cai-conversation-dev1704836562
Viewer • Updated • 128 • 4 -
pvduy/dpo_data
Viewer • Updated • 197k • 4 -
vwxyzjn/cai-conversation-dev1705363150
Viewer • Updated • 128 • 4 -
vwxyzjn/cai-conversation-dev1705620998
Viewer • Updated • 256 • 4 -
vwxyzjn/cai-conversation-dev1705631776
Viewer • Updated • 256 • 4 -
lamhieu/beyond_dpo_en
Viewer • Updated • 25k • 4 -
CognitiveLab/hh-rlhf-json
Viewer • Updated • 161k • 4 -
vwxyzjn/openhermes-dev__mistralai_Mistral-7B-Instruct-v0.1__1707330973
Viewer • Updated • 167 • 2 -
sanduntg/test_vsort_classification
Viewer • Updated • 99 • 2 -
mnoukhov/openai_comparisons_20k_regen_and_relabelled
Viewer • Updated • 20k • 2 -
vwxyzjn/ultrafeedback_binarized_1708454270
Viewer • Updated • 25.3k • 2 -
sanduntg/cpcdata_ppo
Viewer • Updated • 24 • 2 -
hon9kon9ize/yue-truthy
Viewer • Updated • 2.03k • 3 -
aengusl/train_hp_dpo_unlrn_ds
Viewer • Updated • 927 • 2 -
vwxyzjn/hh-rlhf
Viewer • Updated • 100 • 3 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-preference-64-nsample-2_filter_gold_thr_0.2_self_160m
Viewer • Updated • 37.9k • 2 -
boopysaur/user3-dpo-small
Updated • 1 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-preference-64-nsample-12_filter_gold_thr_0.1_self_160m
Viewer • Updated • 37.9k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_160m_bo2_100_kl_0.1_prm_70m_thr_0.3_seed_1
Viewer • Updated • 568k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_160m_bo2_100_kl_0.1_prm_70m_thr_0.3_seed_3
Viewer • Updated • 568k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_160m_bo2_100_kl_0.1_prm_160m_thr_0.3_seed_3
Viewer • Updated • 568k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.3_seed_1
Viewer • Updated • 568k • 4 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_160m_bo16_2_mix_50_kl_0.1_prm_160m_thr_1.0_seed_1
Viewer • Updated • 568k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_160m_bo16_2_mix_50_kl_0.1_prm_160m_thr_1.0_seed_2
Viewer • Updated • 568k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.1_seed_3
Viewer • Updated • 568k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_160m_bo16_2_mix_50_kl_0.1_prm_160m_thr_0.3_seed_3
Viewer • Updated • 568k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_1.4b_bo16_2_64_mix_50_kl_0.1_prm_410m_thr_0.1_seed_2
Viewer • Updated • 189k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_1.4b_bo16_2_64_mix_50_kl_0.1_prm_160m_thr_0.3_seed_2
Viewer • Updated • 189k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_1.4b_bo16_2_64_mix_50_kl_0.1_prm_160m_thr_0.3_seed_3
Viewer • Updated • 568k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_1.4b_bo2_100_kl_0.1_prm_410m_thr_0.3_seed_2
Viewer • Updated • 189k • 2 -
Mitsuki-Sakamoto/alfa-deberta-re-pref-64-fil_self_1.4b_bo16_2_64_mix_50_kl_0.1_prm_160m_thr_0.0_seed_1_t_1.0
Viewer • Updated • 94.6k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo2_100_kl_0.1_prm_70m_thr_0.0_seed_3_t_1.0
Viewer • Updated • 568k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.0_seed_1_tp_0.9
Viewer • Updated • 568k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.0_seed_2_tp_0.9
Viewer • Updated • 568k • 2 -
Mitsuki-Sakamoto/fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.5_seed_3_t_1.0_eval
Viewer • Updated • 568k • 2 -
dinaaaaaa/lima_rand_sel_50_preference_self_reward
Viewer • Updated • 223 • 2 -
Jessiecs/7374-assignment4-question2_dataset_for_DPO
Viewer • Updated • 50 • 2 -
ShenaoZ/0.0_idpo_same_3iters_debug_dataset
Viewer • Updated • 22.4k • 2 -
guoyu-zhang/shp_1
Viewer • Updated • 1k • 2 -
guoyu-zhang/shp_2
Viewer • Updated • 1k • 2 -
guoyu-zhang/shp_3
Viewer • Updated • 1k • 2 -
ShenaoZ/0.001_ablation_4iters_bs256_nodpo_dataset
Viewer • Updated • 69.1k • 2 -
NickyNicky/DPO_tokenizer_phi_3_test
Viewer • Updated • 10 • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.0_seed_3
Viewer • Updated • 303k • 3 -
YYYYYYibo/ultrafeedback_binarized_phase_0_part_0
Viewer • Updated • 100 • 2 -
ShenaoZhang/0.0001_3iters_bs256_nodpo_full6w_dataset
Viewer • Updated • 67.1k • 2 -
communityai/system_identity_remove_preference_google
Viewer • Updated • 93 • 2 -
communityai/system_identity_remove_preference_alibaba_cloud
Viewer • Updated • 93 • 2 -
communityai/system_identity_remove_preference_deepseek
Viewer • Updated • 93 • 2 -
communityai/system_identity_remove_preference_gpt
Viewer • Updated • 93 • 2 -
communityai/system_identity_remove_preference_gpt_4
Viewer • Updated • 93 • 3 -
communityai/system_identity_remove_preference_qwen
Viewer • Updated • 93 • 2 -
communityai/system_identity_remove_preference_qwen_2
Viewer • Updated • 93 • 2 -
communityai/system_identity_remove_preference_command_r_plus_symbol
Viewer • Updated • 93 • 2 -
communityai/mlabonne___orpo-dpo-mix-40k-alignment
Viewer • Updated • 42.7k • 2 -
communityai/system_identity_remove_preference_command-v2
Viewer • Updated • 93 • 2 -
communityai/system_identity_remove_preference_phi-v2
Viewer • Updated • 93 • 2 -
communityai/system_identity_remove_preference_deepseek-v2
Viewer • Updated • 93 • 2 -
communityai/system_identity_remove_preference_llama_3-v2
Viewer • Updated • 93 • 2 -
communityai/system_identity_remove_preference_llama-v2
Viewer • Updated • 93 • 2 -
communityai/system_identity_remove_preference_gpt_5-v2
Viewer • Updated • 93 • 2 -
communityai/system_identity_remove_preference_gpt_4-v2
Viewer • Updated • 93 • 2 -
communityai/system_identity_remove_preference_alibaba-v2
Viewer • Updated • 93 • 2 -
communityai/system_identity_adept_preference_v2-corrected
Viewer • Updated • 202 • 2 -
nbalepur/Mnemonic_Chosen_Rejected
Viewer • Updated • 472 • 2 -
C-Stuti/llama3-8b-orpo-con
Viewer • Updated • 3.36k • 2 -
Ksgk-fy/alignment-dpo-test2-mode-4
Viewer • Updated • 720 • 2 -
ShenaoZ/0.0001_withdpo_3iters_bs256_531lr_dataset
Viewer • Updated • 44.8k • 2 -
YYYYYYibo/ultrafeedback_binarized_rank4_all_train_part_3
Viewer • Updated • 20.5k • 2 -
StrangeSX/SGXT1
Viewer • Updated • 99 • 2 -
YYYYYYibo/ultrafeedback_binarized_dataset_offline_pairrm_part0_mini_2
Viewer • Updated • 4.9k • 2 -
theGhoul21/irpo-dataset-v2
Viewer • Updated • 17.9k • 2 -
YYYYYYibo/ultrafeedback_binarized_doff_no_golden_train_part_2_mini_2
Viewer • Updated • 4.78k • 2 -
ShenaoZ/0.0001_sft_nodpo_5iters_bs256_5102lr_dataset
Viewer • Updated • 71.1k • 2 -
ShenaoZ/0.0005_mistral_withdpo_4iters_bs256_5551lr_dataset
Viewer • Updated • 51.8k • 2 -
euiyulsong/arc_train_ds
Viewer • Updated • 1.12k • 2 -
reciprocate/dpo-objective
Viewer • Updated • 512 • 2 -
DuongTrongChi/detoxic-dpo-format
Viewer • Updated • 46.6k • 2 -
euiyulsong/generated_data_all_cos_3000
Viewer • Updated • 3k • 2 -
mcding-org/CorrectDPO-Eval-DPP_Q0.5B_PP10_beta0.10p0.00pi0.20
Updated • 2 -
mcding-org/CorrectDPO-Eval-DPP_Q0.5B_PP10_beta0.10p0.30pi0.00
Updated • 2 -
mcding-org/CorrectDPO-Eval-DPR_Q0.5B_PP10_beta0.10g0.30gamma0.00
Updated • 2 -
mcding-org/CorrectDPO-Eval-DDP_Q0.5B_PP10_beta0.10r0.40rho0.00
Updated • 2 -
YYYYYYibo/ultrafeedback_binarized_simple_online_vllm_part_2_mini_1
Viewer • Updated • 5k • 2 -
mcding-org/CorrectDPO-Eval-DPR_Q0.5B_PP10_beta0.10g0.20gamma0.50
Updated • 2 -
mcding-org/CorrectDPO-Eval-DPR_Q0.5B_PP10_beta0.10g0.10gamma0.50
Updated • 2 -
YYYYYYibo/ultrafeedback_binarized_simple_online_vllm_part_3_mini_2
Viewer • Updated • 5.28k • 2 -
yasirchemmakh/dpo_llama3
Viewer • Updated • 43 • 2 -
mcding-org/CorrectDPO-Eval-DPO_Pm3B_U0_beta0.10
Updated • 3 -
mcding-org/CorrectDPO-Eval-DPO_L8B_U0_beta0.10
Updated • 3 -
Piteryo/hf-trl-1024
Viewer • Updated • 1.28k • 2 -
jayhii/orpo_2sep_data_font
Viewer • Updated • 10k • 2 -
sfanm/ultrafeedback_llama3
Viewer • Updated • 60.2k • 2 -
ContextualAI/ultrabin_clean_max_chosen_min_rejected_rationalized
Viewer • Updated • 60.9k • 2 -
nhyha/DPO
Viewer • Updated • 1 • 2 -
YYYYYYibo/ultrafeedback_binarized_ave_pi_vllm_part_3_mini_2
Viewer • Updated • 5.28k • 2 -
YYYYYYibo/ultrafeedback_binarized_ave_pi_vllm_part_3_mini_3
Viewer • Updated • 5.29k • 2 -
YYYYYYibo/ultrafeedback_binarized_ave_pi_with_golden_vllm_part_3_mini_3
Viewer • Updated • 5.29k • 2 -
YYYYYYibo/ultrafeedback_binarized_ave_pi_with_golden_train_part_3_mini_3
Viewer • Updated • 5.29k • 2 -
Columbia-NLP/DPO-distilabel-capybara-dpo-7k-binarized
Viewer • Updated • 7.56k • 2 -
beom115/test2
Viewer • Updated • 72.5k • 2 -
maywell/ko_Ultrafeedback_binarized_10k
Viewer • Updated • 10k • 4 • 5 -
vicgalle/OpenHermesPreferences-1k
Viewer • Updated • 1.11k • 2 • 3 -
mlabonne/oasst-preferences
Viewer • Updated • 22.3k • 2 • 3 -
beyond/rlhf-reward-single-round
Viewer • Updated • 25k • 2 • 2 -
alvarobartt/Anthropic_HH_Golden_Formatted
Viewer • Updated • 44.8k • 4 • 2 -
distilabel-internal-testing/ohp-writing
Viewer • Updated • 1.53k • 2 • 2 -
sablo/HelpSteer_binarized
Viewer • Updated • 8.55k • 4 • 1 -
Suraponn/iapp_for_orpo
Viewer • Updated • 121k • 2 • 1 -
umarigan/openhermespreference_tr
Viewer • Updated • 989k • 2 • 2 -
orpo-explorers/OHP-15k
Viewer • Updated • 15.4k • 2 • 1 -
NickyNicky/oasst2_orpo_mix_tokenizer_phi_3_v1
Viewer • Updated • 54.3k • 2 • 1 -
NickyNicky/Colossal_Translation_EN_ES_ORPO_DPO_Gemma
Viewer • Updated • 1.7M • 2 • 2 -
NickyNicky/DIBT_prompts_ranked_En_Es_orpo_dpo_chatML_gemma_V3
Viewer • Updated • 20.4k • 2 • 1 -
NickyNicky/nano_finance_200k_en_es_chatML_gemma_orpo_dpo
Viewer • Updated • 201k • 3 • 1 -
AlekseyKorshuk/chai-real-and-synthetic
Viewer • Updated • 154k • 2 -
ummagumm-a/cup-it-ds-classification-pairwise-train-val
Viewer • Updated • 352k • 2 -
samxm111/rlhf-reward-single-round
Viewer • Updated • 25k • 2 -
vwxyzjn/cai-conversation-dev1-h4
Viewer • Updated • 16.4k • 4 -
alvarobartt/Anthropic_HH_Golden_Extended
Viewer • Updated • 89.7k • 4 -
mnoukhov/openai_summarize_generated_20k_relabel_410m_dpo1
Viewer • Updated • 20k • 4 -
mnoukhov/openai_summarize_generated_20k_relabel_1b
Viewer • Updated • 20k • 4 -
GokhanAI/INST_Synthetic_LLAMA
Viewer • Updated • 26.3k • 4 -
0x7o/oasst-ru-dpo-v1
Viewer • Updated • 1.32k • 4 -
Jaredquek/dpoedtech
Viewer • Updated • 3.25k • 4 -
CognitiveLab/hh-rlhf-formatted
Viewer • Updated • 161k • 4 -
CognitiveLab/hh-rlhf-formatted-10000
Viewer • Updated • 10k • 4 -
arianhosseini/openai_comparisons_20k_regen_and_relabelled
Viewer • Updated • 25k • 4 -
Saugatkafley/okapi-ranking
Viewer • Updated • 126k • 4 -
vwxyzjn/self-reward-dev1706109551
Viewer • Updated • 16 • 4 -
manishiitg/jondurbin-gutenberg-dpo-v0.1
Viewer • Updated • 1.8k • 2 -
argilla/ultrafeedback-capybara-mix-5k
Viewer • Updated • 5k • 2 -
vwxyzjn/openhermes-dev__mistralai_Mistral-7B-Instruct-v0.1__1706885434
Viewer • Updated • 24 • 2 -
vwxyzjn/openhermes-dev__mistralai_Mixtral-8x7B-Instruct-v0.1__1706903049
Viewer • Updated • 167 • 2 -
pvduy/dpo_data_capy
Viewer • Updated • 47.6k • 2 -
dkshjn/processed_distilabel-capybara-dpo-7k-binarized
Viewer • Updated • 7.56k • 2 -
weijie210/UC_prefs_iter_0_pairwise
Viewer • Updated • 14.4k • 2 -
vwxyzjn/openhermes-dev__mistralai_Mistral-7B-Instruct-v0.1__1707331096
Viewer • Updated • 87 • 2 -
vwxyzjn/openhermes-dev__mistralai_Mistral-7B-Instruct-v0.1__1707331527
Viewer • Updated • 462 • 2 -
vwxyzjn/openhermes-dev__meta-llama_Llama-2-70b-chat-hf__1707332943
Viewer • Updated • 167 • 2 -
nz/100_v2_rlhf
Viewer • Updated • 122k • 2 -
vwxyzjn/ultrafeedback_binarized_1708035667
Viewer • Updated • 63.1k • 2 -
vwxyzjn/ultrafeedback_binarized_1708702930
Viewer • Updated • 27k • 2 -
jikaixuan/mistral_generated
Viewer • Updated • 61.1k • 2 -
arianhosseini/summ_dpo1b1_ngen10_max_2ndmax
Viewer • Updated • 20k • 2 -
nz/closest_to_3000_range_1000_to_9000
Viewer • Updated • 11k • 2 -
nz/closest_to_5000_range_1000_to_9000
Viewer • Updated • 11k • 2 -
hon9kon9ize/yue-toxic-dpo
Viewer • Updated • 1.07k • 5 -
vwxyzjn/hh-rlhf-trl-style
Viewer • Updated • 100 • 2 -
Mitsuki-Sakamoto/filter_dataset_test
Viewer • Updated • 73 • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-preference-64-nsample-2_filter_gold_thr_0.5_self_160m
Viewer • Updated • 37.9k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-preference-64-nsample-12_filter_gold_thr_0.3_self_160m
Viewer • Updated • 37.9k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-preference-64-nsample-12_filter_gold_thr_1.0_self_160m
Viewer • Updated • 18.9k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_160m_bo2_100_kl_0.1_prm_70m_thr_0.1_seed_1
Viewer • Updated • 568k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_160m_bo2_100_kl_0.1_prm_160m_thr_0.1_seed_3
Viewer • Updated • 568k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_160m_bo2_100_kl_0.1_prm_160m_thr_0.3_seed_1
Viewer • Updated • 568k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_160m_bo2_100_kl_0.1_prm_160m_thr_1.0_seed_1
Viewer • Updated • 568k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_160m_bo2_100_kl_0.1_prm_160m_thr_0.1_seed_2
Viewer • Updated • 568k • 2 -
when2rl/dpo-mix-7k-rescaled_reformatted
Viewer • Updated • 7.5k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_1.4b_bo16_2_64_mix_50_kl_0.1_prm_160m_thr_0.1_seed_1
Viewer • Updated • 568k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.0_seed_1
Viewer • Updated • 568k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_160m_bo16_2_mix_50_kl_0.1_prm_160m_thr_0.0_seed_1
Viewer • Updated • 568k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.1_seed_2
Viewer • Updated • 568k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_160m_bo16_2_mix_50_kl_0.1_prm_160m_thr_0.3_seed_2
Viewer • Updated • 568k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_160m_bo16_2_mix_50_kl_0.1_prm_160m_thr_0.0_seed_3
Viewer • Updated • 568k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.3_seed_3
Viewer • Updated • 568k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_1.4b_bo16_2_64_mix_50_kl_0.1_prm_410m_thr_1.0_seed_2
Viewer • Updated • 189k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_1.4b_bo16_2_64_mix_50_kl_0.1_prm_410m_thr_0.1_seed_3
Viewer • Updated • 189k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_1.4b_bo16_2_64_mix_50_kl_0.1_prm_410m_thr_1.0_seed_3
Viewer • Updated • 189k • 3 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_1.4b_bo16_2_64_mix_50_kl_0.1_prm_410m_thr_0.3_seed_3
Viewer • Updated • 189k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_1.4b_bo2_100_kl_0.1_prm_410m_thr_0.3_seed_1
Viewer • Updated • 189k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_1.4b_bo2_100_kl_0.1_prm_160m_thr_0.3_seed_2
Viewer • Updated • 189k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_14m_thr_0.0_seed_3_t_1.0
Viewer • Updated • 568k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.5_seed_2_t_1.0
Viewer • Updated • 568k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.3_seed_2_t_1.0
Viewer • Updated • 568k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.1_seed_3_t_1.0
Viewer • Updated • 568k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_160m_thr_0.0_seed_2_t_1.0
Viewer • Updated • 568k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.0_seed_2_t_0.75
Viewer • Updated • 568k • 2 -
Mitsuki-Sakamoto/fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.0_seed_1_t_1.0_eval
Viewer • Updated • 568k • 2 -
Mitsuki-Sakamoto/fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.1_seed_1_t_1.0_eval
Viewer • Updated • 568k • 2 -
Mitsuki-Sakamoto/fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.1_seed_2_t_1.0_eval
Viewer • Updated • 568k • 2 -
Mitsuki-Sakamoto/fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.3_seed_2_t_1.0_eval
Viewer • Updated • 568k • 2 -
orpo-explorers/OpenHermesPreferences-250k
Viewer • Updated • 250k • 2 -
sazirarrwth99/kangoroo_dpo_trainer_final
Viewer • Updated • 23.3k • 2 -
wenbopan/cmmlu_dpo_pairs
Viewer • Updated • 5.04k • 4 -
ShenaoZhang/0.001_idpo_dataset
Viewer • Updated • 44.8k • 2 -
AnushaKulkarni/preferred_dataset2
Viewer • Updated • 50 • 2 -
mnoukhov/summarize_from_feedback_tldr3_generated_20k_vllm_pythia1b_dpo_temp0.7
Viewer • Updated • 20k • 2 -
arianhosseini/ultrafeedback_binarized_relabel1b
Viewer • Updated • 63.1k • 2 -
ShenaoZ/0.001_idpo_same_scratch_dataset
Viewer • Updated • 106k • 2 -
mnoukhov/summarize_from_feedback_tldr3_generated_20k_relabel_pythia1b_dpo_temp0.7_length128
Viewer • Updated • 20k • 2 -
guoyu-zhang/usp_2
Viewer • Updated • 1k • 2 -
guoyu-zhang/usp_4
Viewer • Updated • 1k • 2 -
DuongTrongChi/hh-rlhf
Viewer • Updated • 161k • 2 -
when2rl/gutenberg-dpo-v0.1_reformatted
Viewer • Updated • 918 • 3 -
ShenaoZ/0.0001_ablation_dataset
Viewer • Updated • 44.8k • 2 -
mnoukhov/summarize_from_feedback_tldr3_labelled_vllm_20k_dpo_costa_1b_fp16.yml_3d94f50_b9ff2
Viewer • Updated • 9.5k • 2 -
ShenaoZ/0.01_ablation_4iters_bs256_dataset
Viewer • Updated • 51.8k • 2 -
orpo-explorers/OHP-15k-Stratified-1
Viewer • Updated • 15k • 2 -
orpo-explorers/OHP-15k-Stratified-2
Viewer • Updated • 15k • 2 -
ShenaoZhang/0.001_ablation_5iters_bs128_dataset
Viewer • Updated • 12.2k • 2 -
ShenaoZ/0.001_3iters_bs128_declr_nodpo_useresponse_dataset
Viewer • Updated • 67.1k • 2 -
NickyNicky/alexredna_oasst2_dpo_pairs
Viewer • Updated • 10k • 2 -
ShenaoZ/0.001_4iters_bs256_nodpo_only2third_dataset
Viewer • Updated • 12.2k • 2 -
ShenaoZhang/0.001_4iters_bs128_nodpo_only4w_userresponse_dataset
Viewer • Updated • 48k • 2 -
ShenaoZhang/0.001_4iters_bs256_nodpo_only4w_userresponse_dataset
Viewer • Updated • 48k • 2 -
ShenaoZhang/0.001_4iters_bs128_nodpo_only4w_dataset
Viewer • Updated • 48k • 2 -
ShenaoZhang/0.01_4iters_bs256_nodpo_only4w_dataset
Viewer • Updated • 48k • 2 -
YYYYYYibo/ultrafeedback_binarized_phase_1_part_1_ranked
Viewer • Updated • 10k • 2 -
YYYYYYibo/ultrafeedback_binarized_phase_2_part_2
Viewer • Updated • 5.28k • 2 -
YYYYYYibo/ultrafeedback_binarized_phase_2_part_1minipart_3
Viewer • Updated • 1k • 2 -
communityai/system_identity_remove_preference_openai
Viewer • Updated • 93 • 2 -
communityai/system_identity_remove_preference_llama_3
Viewer • Updated • 93 • 1 -
communityai/system_identity_remove_preference_mixtral
Viewer • Updated • 93 • 2 -
communityai/system_identity_adept_preference_v2
Viewer • Updated • 202 • 2 -
communityai/system_identity_remove_preference_command_r-v2
Viewer • Updated • 93 • 2 -
communityai/system_identity_adept_preference_v1-corrected
Viewer • Updated • 202 • 2 -
ShenaoZhang/0.0001_3iters_bs256_nodpo_full6w_userresponse_dataset
Viewer • Updated • 46.8k • 2 -
YYYYYYibo/ultrafeedback_binarized_left_part_2
Viewer • Updated • 15k • 2 -
when2rl/mt_bench_human_judgments_reformatted
Viewer • Updated • 8.96k • 2 -
iamnguyen/ultrafeedback_translated
Viewer • Updated • 999 • 2 -
YYYYYYibo/ultrafeedback_binarized_epoch_2_train_part_2
Viewer • Updated • 25k • 2 -
ShenaoZ/0.0001_withdpo_4iters_bs256_5102lr_misit_correct_dataset
Viewer • Updated • 51.8k • 2 -
ShenaoZ/0.0005_withdpo_4iters_bs256_5102lr_dataset
Viewer • Updated • 51.8k • 2 -
YYYYYYibo/ultrafeedback_binarized_real_rank4_all_minpi_part_3
Viewer • Updated • 20.5k • 2 -
ShenaoZ/0.0001_sft_nodpo_3iters_bs256_555lr_dataset
Viewer • Updated • 67.1k • 2 -
mnoukhov/summarize_from_feedback_tldr3_unlabelled_vllm_dpo_costa_2.8b_bf16.yml_6e799_new
Viewer • Updated • 20k • 2 -
YYYYYYibo/ultrafeedback_binarized_new_gen_part_2
Viewer • Updated • 5k • 2 -
YYYYYYibo/ultrafeedback_binarized_dataset_offline_part0
Viewer • Updated • 19.6k • 2 -
YYYYYYibo/ultrafeedback_binarized_dataset_offline_pairrm_part1_mini_2
Viewer • Updated • 4.9k • 2 -
YYYYYYibo/ultrafeedback_binarized_doff_no_golden_vllm_part_2_mini_2
Viewer • Updated • 4.1k • 2 -
YYYYYYibo/ultrafeedback_binarized_doff_no_golden_vllm_part_2_mini_1
Viewer • Updated • 5k • 2 -
ShenaoZ/0.0001_withdpo_3iters_bs256_5102lr_dataset
Viewer • Updated • 44.8k • 2 -
YYYYYYibo/ultrafeedback_binarized_doff_real_no_golden_vllm_part_2_mini_1
Viewer • Updated • 5k • 2 -
ShenaoZ/0.001_withdpo_4iters_bs256_555lr_dataset
Viewer • Updated • 51.8k • 2 -
uine/single-dpo-practice-dataset
Viewer • Updated • 2.11k • 2 -
ShenaoZ/0.0001_withdpo_4iters_bs256_5551lr_dataset
Viewer • Updated • 51.8k • 2 -
ShenaoZ/0.0005_withdpo_4iters_bs256_2epoch_5551lr_dataset
Viewer • Updated • 51.8k • 2 -
mnoukhov/summarize_from_feedback_tldr3_unlabelled_vllm_pythia410m-dpo-tldr
Viewer • Updated • 107k • 2 -
ContextualAI/tiny_train_test_ultrafeedback_binarized
Viewer • Updated • 20 • 2 -
mnoukhov/summarize_from_feedback_tldr3_unlabelled_vllm_pythia410m-dpo-tldr-step873
Viewer • Updated • 20k • 2 -
ShenaoZhang/0.0001_zephyr_5551_4iters_bs256_dataset
Viewer • Updated • 51.8k • 2 -
DuongTrongChi/dpo-detoxic
Viewer • Updated • 46.6k • 2 -
YYYYYYibo/ultrafeedback_binarized_simple_online_vllm_part_1_mini_0
Viewer • Updated • 5k • 2 -
YYYYYYibo/ultrafeedback_binarized_simple_online_vllm_part_1_mini_2
Viewer • Updated • 5k • 2 -
mcding-org/CorrectDPO-Eval-DDP_Q0.5B_PP10_beta0.10r0.00rho0.00
Updated • 2 -
mcding-org/CorrectDPO-Eval-DPR_Q0.5B_PP10_beta0.10g0.00gamma0.00
Updated • 2 -
mcding-org/CorrectDPO-Eval-DDP_Q0.5B_PP10_beta0.10r0.10rho0.10
Updated • 2 -
mcding-org/CorrectDPO-Eval-DPP_Q0.5B_PP10_beta0.10p0.10pi0.00
Updated • 2 -
mcding-org/CorrectDPO-Eval-DDP_Q0.5B_PP10_beta0.10r0.20rho0.20
Updated • 2 -
mcding-org/CorrectDPO-Eval-DDP_Q0.5B_PP10_beta0.10r0.30rho0.00
Updated • 2 -
mcding-org/CorrectDPO-Eval-DDP_Q0.5B_PP10_beta0.10r0.20rho0.30
Updated • 2 -
mcding-org/CorrectDPO-Eval-DPP_Q0.5B_PP10_beta0.10p0.20pi0.00
Updated • 2 -
mcding-org/CorrectDPO-Eval-DDP_Q0.5B_PP10_beta0.10r0.50rho0.00
Updated • 2 -
mcding-org/CorrectDPO-Eval-DPR_Q0.5B_PP10_beta0.10g0.10gamma0.30
Updated • 2 -
mcding-org/CorrectDPO-Eval-DDP_Q0.5B_PP10_beta0.10r0.40rho0.10
Updated • 2 -
mcding-org/CorrectDPO-Eval-DPP_Q0.5B_PP10_beta0.10p0.00pi0.50
Updated • 2 -
mcding-org/CorrectDPO-Eval-DPP_Q0.5B_PP10_beta0.10p0.00pi0.30
Updated • 2 -
mcding-org/CorrectDPO-Eval-DDP_Q0.5B_PP10_beta0.10r0.50rho0.10
Updated • 2 -
mcding-org/CorrectDPO-Eval-DPR_Q0.5B_PP10_beta0.10g0.30gamma0.10
Updated • 2 -
mcding-org/CorrectDPO-Eval-DDP_Q0.5B_PP10_beta0.10r0.40rho0.20
Updated • 2 -
YYYYYYibo/ultrafeedback_binarized_simple_online_train_part_1_mini_3
Viewer • Updated • 5k • 2 -
mcding-org/CorrectDPO-Eval-DPP_Q0.5B_PP10_beta0.10p0.20pi0.40
Updated • 2 -
mcding-org/CorrectDPO-Eval-DDP_Q0.5B_PP10_beta0.10r0.40rho0.40
Updated • 2 -
mcding-org/CorrectDPO-Eval-DDP_Q0.5B_PP10_beta0.10r0.50rho0.40
Updated • 2 -
mcding-org/CorrectDPO-Eval-DDP_Q0.5B_PP10_beta0.10r0.00rho0.50
Updated • 2 -
mcding-org/CorrectDPO-Eval-DDP_Q0.5B_PP10_beta0.10r0.20rho0.50
Updated • 2 -
mcding-org/CorrectDPO-Dataset-U10
Updated • 2 -
mcding-org/CorrectDPO-Dataset-U30
Updated • 2 -
mcding-org/CorrectDPO-Eval-DDP_Pm3B_U0_beta0.10r0.30rho0.20
Updated • 2 -
GENIAC-Team-Ozaki/tuninig-dataset_pref_20pct_v2_full-sft-finetuned-stage4-iter86000-v2
Viewer • Updated • 18.8k • 2 -
berquetR/dpo_preference_dataset
Preview • Updated • 2 -
patruff/chuckles_dpo_pairsA
Viewer • Updated • 106 • 2 -
ihughes15234/tictactoe_DPO
Viewer • Updated • 765 • 2 -
rajj0/god_sent_data_v2
Viewer • Updated • 2.84k • 2 -
nhyha/DPO_2
Viewer • Updated • 5 • 2 -
YYYYYYibo/ultrafeedback_binarized_ave_pi_train_part_2_mini_2
Viewer • Updated • 5k • 2 -
YYYYYYibo/ultrafeedback_binarized_ave_pi_train_part_3_mini_3
Viewer • Updated • 5.29k • 2 -
YYYYYYibo/ultrafeedback_binarized_ave_pi_with_golden_vllm_part_2_mini_2
Viewer • Updated • 5k • 2 -
YYYYYYibo/ultrafeedback_binarized_ave_pi_with_golden_vllm_part_2_mini_1
Viewer • Updated • 5k • 2 -
YYYYYYibo/ultrafeedback_binarized_ave_pi_with_golden_train_part_2_mini_2
Viewer • Updated • 5k • 2 -
YYYYYYibo/ultrafeedback_binarized_ave_pi_with_golden_vllm_part_3_mini_2
Viewer • Updated • 5.28k • 2 -
YYYYYYibo/ultrafeedback_binarized_ave_pi_with_golden_train_part_3_mini_1
Viewer • Updated • 5.28k • 2 -
YYYYYYibo/ultrafeedback_binarized_ave_pi_with_golden_train_part_3_mini_2
Viewer • Updated • 5.28k • 2 -
mnoukhov/summarize_from_feedback_oai_preprocessing_1706381144_relabel2_llama8b
Viewer • Updated • 92.1k • 2 -
YYYYYYibo/ultrafeedback_binarized_imp_sam_train_part_2
Viewer • Updated • 19.1k • 2 -
YYYYYYibo/ultrafeedback_binarized_imp_sam_minpi_part_3
Viewer • Updated • 19.6k • 2 -
YYYYYYibo/ultrafeedback_binarized_imp_sam_train_part_3
Viewer • Updated • 19.6k • 2 -
YYYYYYibo/ultrafeedback_binarized_imp_sam_1_minpi_part_2
Viewer • Updated • 19.1k • 2 -
YYYYYYibo/ultrafeedback_binarized_imp_sam_1_train_part_2
Viewer • Updated • 19.1k • 2 -
YYYYYYibo/ultrafeedback_binarized_imp_sam_1_minpi_part_3
Viewer • Updated • 19.8k • 2 -
YYYYYYibo/ultrafeedback_binarized_imp_sam_1_train_part_3
Viewer • Updated • 19.8k • 2 -
YYYYYYibo/ultrafeedback_binarized_gshf_lora_vllm_1_part_2
Viewer • Updated • 20k • 2 -
YYYYYYibo/ultrafeedback_binarized_gshf_lora_vllm_2_part_2
Viewer • Updated • 20k • 2 -
YYYYYYibo/ultrafeedback_binarized_gshf_lora_vllm_1_part_3
Viewer • Updated • 21.1k • 2 -
YYYYYYibo/ultrafeedback_binarized_gshf_lora_vllm_2_part_3
Viewer • Updated • 21.1k • 2 -
YYYYYYibo/ultrafeedback_binarized_gshf_lora_train_part_3
Viewer • Updated • 21.1k • 2 -
joshuasundance/mypo-4k-rfc-val-phi3test
Viewer • Updated • 100 • 2 -
davanstrien/dataset-tldr-preference-dpo
Viewer • Updated • 522 • 501 • 11 -
declare-lab/audio-alpaca
Viewer • Updated • 15k • 80 • 9 -
HuggingFaceH4/grok-conversation-harmless2
Viewer • Updated • 44.8k • 4 • 6 -
monology/oasst2_dpo
Viewer • Updated • 28.4k • 4 • 3 -
HuggingFaceH4/orca_dpo_pairs_no_system_prompt
Viewer • Updated • 12.9k • 5 • 3 -
udkai/klexikon_dpo
Viewer • Updated • 2.89k • 4 • 3 -
Dahoas/rl-prompt-dataset
Viewer • Updated • 207k • 2 • 2 -
reciprocate/ultrafeedback_cleaned_high_dpo
Viewer • Updated • 40k • 4 • 2 -
giux78/ultrafeedback-binarized-preferences-cleaned-ita-ready
Viewer • Updated • 60.9k • 4 • 2 -
AlekseyKorshuk/synthetic-instruct-gptj-pairwise
Viewer • Updated • 33.1k • 2 • 1 -
Deojoandco/reward_model_anthropic_88
Viewer • Updated • 8.55k • 2 • 1 -
SAGI-1/ultrafeedback_binarized_dpo
Viewer • Updated • 64k • 4 • 1 -
ThWu/dpo_prompt_r
Viewer • Updated • 183k • 4 • 1 -
0x7o/fialka-v2-dpo
Viewer • Updated • 2.47k • 19 • 1 -
reciprocate/ultrafeedback_cleaned_v2_dpo
Viewer • Updated • 58.6k • 4 • 1 -
nutorbit/news-headline-dpo
Viewer • Updated • 2.37k • 4 • 1 -
giux78/ultrafeedback-binarized-preferences-cleaned-ita
Viewer • Updated • 60.9k • 4 • 1 -
NickyNicky/Colossal_Translation_Spanish_to_English_AND_English_to_Spanish_ORPO_DPO_Gemma
Viewer • Updated • 3.4M • 5 • 3 -
thepowerfuldeez/Qwen-summarize-dataset-train
Viewer • Updated • 20.4k • 2 • 1 -
AlekseyKorshuk/davinci-pairwise
Viewer • Updated • 144k • 2 -
AlekseyKorshuk/davinci-pairwise-all
Viewer • Updated • 48k • 2 -
AlekseyKorshuk/davinci-pairwise-tokenized
Viewer • Updated • 72k • 2 -
AlekseyKorshuk/davinci-pairwise-filtered
Viewer • Updated • 108k • 2 -
AlekseyKorshuk/chai-synthetic-pairwise
Viewer • Updated • 45.7k • 2 -
HuggingFaceH4/test-dataset-all-splits
Viewer • Updated • 600 • 2 -
AlekseyKorshuk/lmeh-chai-davinci
Viewer • Updated • 14.4k • 2 -
AlekseyKorshuk/lmeh-chai-synthetic
Viewer • Updated • 4.57k • 2 -
PanoEvJ/GPT3.5_summarization_preference_RLAIF
Viewer • Updated • 100 • 4 -
JuanKO/RLAIF_summarization_preference_gpt35
Viewer • Updated • 1k • 5 -
victorialee/openai_summarize_comparisons_relabel_GPTJ
Updated • 2 -
sayan1101/reward_test_custom_dataset_RLHF
Viewer • Updated • 164 • 4 -
SebastianSchramm/ultrafeedback_binarized_prefs_filtered
Viewer • Updated • 58.1k • 4 -
remyxai/ffmperative_dpo
Viewer • Updated • 1.48k • 4 -
rajammanabrolu/ultrafeedback_binarized
Viewer • Updated • 190k • 4 -
kfkas/test_DPO_dataset
Viewer • Updated • 3.83k • 4 -
varun-v-rao/mimic-cxr-dpo-with-metrics
Viewer • Updated • 125k • 13 • 1 -
mnoukhov/openai_summarize_generated_10k
Viewer • Updated • 10k • 4 -
mnoukhov/openai_summarize_generated_10-20k
Viewer • Updated • 10k • 4 -
mnoukhov/openai_summarize_generated_20k
Viewer • Updated • 20k • 4 -
GokhanAI/INST_Synthetic_MISTRAL
Viewer • Updated • 26.3k • 4 -
dvilasuero/multiturner
Viewer • Updated • 3.43k • 4 -
arianhosseini/openai_summarize_comparisons_relabel_pythia1b_iter1_temp0.7
Viewer • Updated • 20k • 4 -
mnoukhov/compare_results
Viewer • Updated • 100 • 4 -
mnoukhov/openai_summarize_vllm_generated_20k_label410m
Viewer • Updated • 19.9k • 4 -
reciprocate/orca_dpo_pairs
Viewer • Updated • 14.8k • 4 -
reciprocate/pku_better_dpo_pairs
Viewer • Updated • 330k • 4 -
manishiitg/jondurbin-truthy-dpo-v0.1
Viewer • Updated • 2.03k • 4 -
manishiitg/unalignment-toxic-dpo-v0.1
Viewer • Updated • 604 • 4 -
mii-llm/oasst2-dpo-it
Viewer • Updated • 210 • 4 -
UnderstandLing/oasst1_nl_threads_dpo
Viewer • Updated • 25.1k • 4 -
vwxyzjn/cai-conversation-dev1705423021
Viewer • Updated • 2.31k • 4 -
vwxyzjn/cai-conversation-dev1705526305
Viewer • Updated • 256 • 4 -
vwxyzjn/cai-conversation-dev1705676837
Viewer • Updated • 256 • 4 -
arianhosseini/trl_data
Viewer • Updated • 20k • 4 -
weijie210/UC_preference_iter_0
Viewer • Updated • 39.1k • 2 -
weijie210/UC_preference_iter_0_all
Viewer • Updated • 93.2k • 2 -
pvduy/dpo_data_ultra
Viewer • Updated • 80k • 2 -
ogbrandt/gpt35_preference_rlaif
Viewer • Updated • 520 • 2 -
ogbrandt/gpt4_preference_rlaif
Viewer • Updated • 520 • 2 -
Asap7772/ultrafeedback_binarized_narrow_unlabeled
Viewer • Updated • 60.7k • 2 -
weijie210/UFB_reference_rejected
Viewer • Updated • 57.6k • 2 -
vwxyzjn/openhermes-dev__mistralai_Mixtral-8x7B-Instruct-v0.1__1706886961
Viewer • Updated • 24 • 2 -
vwxyzjn/openhermes-dev__mistralai_Mixtral-8x7B-Instruct-v0.1__1706887930
Viewer • Updated • 30 • 2 -
nz/anthropic-hh-golden-rlhf
Viewer • Updated • 44.8k • 2 -
vwxyzjn/openhermes-dev__mistralai_Mixtral-8x7B-Instruct-v0.1__1706893611
Viewer • Updated • 84 • 2 -
vwxyzjn/openhermes-dev__mistralai_Mixtral-8x7B-Instruct-v0.1__1706896441
Viewer • Updated • 5 • 2 -
arianhosseini/summarize_dpo1b1_ngen10_20k
Viewer • Updated • 20k • 2 -
weijie210/UFB_prefs_iter_0_4_bestn
Viewer • Updated • 55.5k • 2 -
weijie210/UC_prefs_iter_0
Viewer • Updated • 31 • 2 -
weijie210/UFB_maximal_prefs
Viewer • Updated • 63.1k • 2 -
vwxyzjn/openhermes-dev__mistralai_Mistral-7B-Instruct-v0.1__1707330518
Viewer • Updated • 167 • 2 -
vwxyzjn/openhermes-dev__mistralai_Mistral-7B-Instruct-v0.1__1707330742
Viewer • Updated • 167 • 2 -
vwxyzjn/openhermes-dev__meta-llama_Llama-2-70b-chat-hf__1707333633
Viewer • Updated • 167 • 2 -
vwxyzjn/openhermes-dev__meta-llama_Llama-2-70b-chat-hf__1707337384
Viewer • Updated • 167 • 2 -
vwxyzjn/openhermes-dev__kaist-ai_prometheus-13b-v1.0__1707405480
Viewer • Updated • 167 • 2 -
vwxyzjn/openhermes-dev__kaist-ai_prometheus-13b-v1.0__1707406141
Viewer • Updated • 167 • 2 -
vwxyzjn/openhermes-dev__kaist-ai_prometheus-13b-v1.0__1707408224
Viewer • Updated • 167 • 2 -
vwxyzjn/openhermes-dev__kaist-ai_prometheus-13b-v1.0__1707422187
Viewer • Updated • 48.3k • 2 -
shidowake/UFeedback_without_gpt_output
Viewer • Updated • 7.68k • 2 -
ibndias/distilabel-capybara-dpo-7k-binarized
Viewer • Updated • 7.56k • 2 -
dlibf/ultra_feedback_zephyr-dpo
Viewer • Updated • 125k • 2 -
dlibf/ultra_feedback_zephyr-sft
Viewer • Updated • 125k • 2 -
vwxyzjn/ultrafeedback_binarized_1707945637
Viewer • Updated • 63.1k • 2 -
vwxyzjn/ultrafeedback_binarized_1707947544
Viewer • Updated • 63.1k • 2 -
arianhosseini/comparisons_20k_regen_labeled_dpo1b1
Viewer • Updated • 20k • 2 -
male-2/0.2.0-public
Viewer • Updated • 1 • 2 -
mnoukhov/openai_summarize_comparisons_tldprompt_relabel_pythia410m-dpo1
Viewer • Updated • 92.5k • 2 -
vwxyzjn/ultrafeedback_binarized_1708381525
Viewer • Updated • 1.9k • 2 -
Radiantloom/distilabel-intel-orca-dpo-pairs-chatml
Viewer • Updated • 12.9k • 2 -
cmcmaster/OpenHermes2.5-dpo-binarized-alpha-trl
Viewer • Updated • 9.79k • 2 -
mnoukhov/openai_summarize_generated_20k_relabel_1b_margin
Viewer • Updated • 20k • 2 -
mnoukhov/openai_summarize_comparisons_tldrprompt_relabel1b_margin
Viewer • Updated • 97.5k • 2 -
mnoukhov/compare_test
Viewer • Updated • 20k • 2 -
mnoukhov/summarize_from_feedback_tldr3_generated_20k_vllm_pythia1b_dpo
Viewer • Updated • 20k • 2 -
mnoukhov/summarize_from_feedback_tldr3_generated_20k_relabel_pythia1b_dpo
Viewer • Updated • 20k • 2 -
mnoukhov/openai_summarize_generated_20k_relabel_1b_predict_410m-dpo1
Viewer • Updated • 20k • 2 -
cnbeining/sentence-segmentation-dpo-raw
Viewer • Updated • 9.18k • 2 -
aengusl/llama_dpo_hhh
Viewer • Updated • 161k • 2 -
aengusl/mistral_dpo_hhh
Viewer • Updated • 161k • 2 -
Baidicoot/dpo_safety_ihy_openhermes
Viewer • Updated • 5k • 2 -
celinelee/thestack_npzeros_dpo
Viewer • Updated • 100k • 2 -
nz/closest_to_5000_range_1000_to_9000_55k
Viewer • Updated • 55.7k • 2 -
ZHLiu627/ultrafeedback_binarized_with_response_full_part2
Viewer • Updated • 21.1k • 2 -
aengusl/noise0_alpaca_sleeper_agents_toy_test_preference_v4
Viewer • Updated • 15.7k • 2 -
vwxyzjn/ultrafeedback_binarized_1710165338
Viewer • Updated • 25k • 1 -
vtiyyal1/AskDocsEmpathy_2k_dpo
Viewer • Updated • 2.12k • 4 -
davidberenstein1957/ultrafeedback-binarized-cleaned-and-filtered-random-split
Viewer • Updated • 6.69k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-preference-64-nsample-2_filter_gold_thr_0.1_self_70m
Viewer • Updated • 37.9k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-preference-64-nsample-2_filter_gold_thr_0.1_self_160m
Viewer • Updated • 37.9k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_160m_bo2_100_kl_0.1_prm_70m_thr_1.0_seed_3
Viewer • Updated • 568k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.1_seed_1
Viewer • Updated • 568k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_1.0_seed_1
Viewer • Updated • 568k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_1.0_seed_2
Viewer • Updated • 568k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_1.0_seed_3
Viewer • Updated • 568k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_160m_bo16_2_mix_50_kl_0.1_prm_160m_thr_0.1_seed_3
Viewer • Updated • 568k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_1.4b_bo16_2_64_mix_50_kl_0.1_prm_160m_thr_0.3_seed_1
Viewer • Updated • 568k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_1.4b_bo16_2_64_mix_50_kl_0.1_prm_410m_thr_1.0_seed_1
Viewer • Updated • 189k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_1.4b_bo2_100_kl_0.1_prm_410m_thr_0.1_seed_1
Viewer • Updated • 189k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_1.4b_bo2_100_kl_0.1_prm_410m_thr_1.0_seed_1
Viewer • Updated • 189k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_1.4b_bo2_100_kl_0.1_prm_410m_thr_1.0_seed_2
Viewer • Updated • 189k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_14m_thr_0.0_seed_1_t_1.0
Viewer • Updated • 568k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.0_seed_3_t_1.0
Viewer • Updated • 568k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.1_seed_1_t_1.0
Viewer • Updated • 568k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.1_seed_2_t_1.0
Viewer • Updated • 568k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_1.0_seed_2_t_1.0
Viewer • Updated • 568k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.0_seed_1_t_0.9
Viewer • Updated • 568k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.0_seed_2_t_0.5
Viewer • Updated • 568k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.0_seed_3_t_0.5
Viewer • Updated • 568k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo2_100_kl_0.1_prm_70m_thr_0.0_seed_1_t_1.0
Viewer • Updated • 568k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.0_seed_1_tp_0.1
Viewer • Updated • 568k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.0_seed_2_tp_0.3
Viewer • Updated • 568k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.0_seed_3_tp_0.1
Viewer • Updated • 568k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.0_seed_3_tp_0.7
Viewer • Updated • 568k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.0_seed_3_tp_0.9
Viewer • Updated • 568k • 2 -
Nbardy/prompt_variance_reward_complete
Viewer • Updated • 412 • 2 -
Mitsuki-Sakamoto/fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.0_seed_3_t_1.0_eval
Viewer • Updated • 568k • 2 -
Mitsuki-Sakamoto/fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.5_seed_1_t_1.0_eval
Viewer • Updated • 568k • 2 -
Mitsuki-Sakamoto/fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_1.0_seed_2_t_1.0_eval
Viewer • Updated • 568k • 2 -
Mitsuki-Sakamoto/fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_1.0_seed_3_t_1.0_eval
Viewer • Updated • 568k • 2 -
orpo-explorers/OpenHermesPreferences-25k
Viewer • Updated • 25k • 2 -
orpo-explorers/OpenHermesPreferences-50k
Viewer • Updated • 50k • 2 -
orpo-explorers/OpenHermesPreferences-100k
Viewer • Updated • 100k • 2 -
ShenaoZ/ultrafeedback_subset
Viewer • Updated • 22k • 1.19k -
ShenaoZhang/0.001_idpo_same_nodpo_dataset
Viewer • Updated • 67.1k • 2 -
ShenaoZhang/0.001_idpo_same_replacechosen_dataset
Viewer • Updated • 44.8k • 2 -
ShenaoZhang/0.001_idpo_noreplacerej_ref_response
Viewer • Updated • 44.8k • 2 -
ShenaoZhang/0.001_idpo_noreplacerej_dataset
Viewer • Updated • 44.8k • 2 -
jinlibao/lima_preference_dataset
Viewer • Updated • 50 • 2 -
hsikchi/tldr-preference-trl-style
Viewer • Updated • 179k • 492 -
gx-ai-architect/helpsteer_preference
Viewer • Updated • 35.6k • 4 -
sophiex/hh-rlhf
Viewer • Updated • 169k • 2 -
when2rl/OpenHermesPreferences_reformatted
Viewer • Updated • 985k • 2 -
mnoukhov/summarize_from_feedback_tldr3_generated_relabel_20k_dpo_costa_1b_fp16.yml_3d94f50_b35a8
Viewer • Updated • 20k • 2 -
ShenaoZ/0.0_ablation_6iters_dataset
Viewer • Updated • 48.8k • 2 -
ShenaoZ/0.0_ablation_dataset
Viewer • Updated • 44.8k • 2 -
UCLAML/snorkel_prompt3
Viewer • Updated • 21k • 2 -
mnoukhov/summarize_from_feedback_tldr3_generated_relabel_20k_dpo_costa_1b_fp16.yml_3d94f50_b9ff2
Viewer • Updated • 20k • 2 -
arianhosseini/hh_with_prompt
Viewer • Updated • 169k • 2 -
mnoukhov/summarize_from_feedback_tldr3_unlabelled_vllm_20k_dpo_costa_1b_fp16.yml_3d94f50_b9ff2
Viewer • Updated • 107k • 2 -
when2rl/OpenHermesPreferences_CamelAI
Viewer • Updated • 78.4k • 2 -
Louieworth/hh-rlhf-trl-style
Viewer • Updated • 100 • 1 -
rippertnt/OpenOrca-dpo-ko-en
Viewer • Updated • 25.6k • 2 -
dmvaldman/showerthought_preferences2
Viewer • Updated • 34k • 2 -
Astris/toxic-dpo-v0.2-embedded
Updated • 2 -
mnoukhov/summarize_from_feedback_tldr3_unlabelled_vllm_dpo_costa_2.8b_bf16.yml_6e799
Viewer • Updated • 107k • 2 -
orpo-explorers/OHP-Stratified-1
Viewer • Updated • 327k • 2 -
ShenaoZ/0.001_ablation_4iters_bs512_dataset
Viewer • Updated • 2k • 2 -
ShenaoZ/0.001_ablation_4iters_bs256_declr_dataset
Viewer • Updated • 51.8k • 2 -
ShenaoZ/0.01_ablation_5iters_bs256_nodpo_dataset
Viewer • Updated • 71.1k • 4 -
ShenaoZ/0.01_ablation_4iters_bs256_nodpo_dataset
Viewer • Updated • 69.1k • 2 -
ShenaoZ/0.001_ablation_4iters_bs256_nodpo_sample2_dataset
Viewer • Updated • 69.1k • 2 -
orpo-explorers/OHP-15k-mathcode
Viewer • Updated • 15k • 2 -
ShenaoZ/0.001_ablation_5iters_bs256_nodpo_dataset
Viewer • Updated • 71.1k • 2 -
ShenaoZhang/0.001_ablation_4iters_bs128_nodpo_dataset
Viewer • Updated • 69.1k • 2 -
ShenaoZhang/0.01_ablation_4iters_bs128_nodpo_dataset
Viewer • Updated • 53.8k • 2 -
ShenaoZ/0.01_ablation_3iters_bs256_nodpo_dataset
Viewer • Updated • 42.8k • 2 -
ShenaoZ/0.001_ablation_4iters_bs256_nodpo_useresponse_dataset
Viewer • Updated • 69.1k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.0_seed_1
Viewer • Updated • 303k • 2 -
ShenaoZ/0.001_3iters_bs128_declr_nodpo_zephyrbeta_dataset
Viewer • Updated • 46.8k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.0_seed_5
Viewer • Updated • 303k • 2 -
ShenaoZhang/0.001_5iters_bs256_nodpo_only4w_dataset
Viewer • Updated • 70k • 2 -
YYYYYYibo/ultrafeedback_binarized_phase_1_part_1_part1
Viewer • Updated • 5k • 2 -
ShenaoZhang/0.1_4iters_bs256_nodpo_only4w_dataset
Viewer • Updated • 48k • 2 -
ShenaoZhang/0.001_3iters_bs256_nodpo_only4w_dataset
Viewer • Updated • 46k • 2 -
YYYYYYibo/ultrafeedback_binarized_phase_2_part_1minipart_1
Viewer • Updated • 1k • 2 -
ShenaoZhang/0.001_6iters_bs256_nodpo_full6w_dataset
Viewer • Updated • 2k • 2 -
ShenaoZhang/0.01_3iters_bs256_nodpo_full6w_dataset
Viewer • Updated • 67.1k • 2 -
communityai/system_identity_remove_preference_meta_ai
Viewer • Updated • 93 • 2 -
communityai/system_identity_remove_preference_facebook
Viewer • Updated • 93 • 3 -
communityai/system_identity_remove_preference_alibaba
Viewer • Updated • 93 • 2 -
communityai/system_identity_remove_preference_mistral
Viewer • Updated • 93 • 3 -
communityai/system_identity_remove_preference_cohere
Viewer • Updated • 93 • 2 -
communityai/system_identity_remove_preference_chatgpt
Viewer • Updated • 93 • 2 -
communityai/system_identity_remove_preference_gpt_3
Viewer • Updated • 93 • 2 -
communityai/system_identity_remove_preference_llama_4
Viewer • Updated • 93 • 2 -
communityai/system_identity_remove_preference_qwen_1.5
Viewer • Updated • 93 • 2 -
communityai/system_identity_remove_preference_command_r
Viewer • Updated • 93 • 2 -
communityai/system_identity_remove_preference_command_r_plus
Viewer • Updated • 93 • 2 -
communityai/system_identity_adept_preference_v1
Viewer • Updated • 202 • 2 -
communityai/system_identity_remove_preference_command_r_plus-v2
Viewer • Updated • 93 • 2 -
communityai/system_identity_remove_preference_coral-v2
Viewer • Updated • 93 • 2 -
communityai/system_identity_remove_preference_mixtral-v2
Viewer • Updated • 93 • 2 -
communityai/system_identity_remove_preference_llama_4-v2
Viewer • Updated • 93 • 2 -
communityai/system_identity_remove_preference_cohere-v2
Viewer • Updated • 93 • 2 -
communityai/system_identity_remove_preference_mistral-v2
Viewer • Updated • 93 • 2 -
communityai/system_identity_remove_preference_facebook-v2
Viewer • Updated • 93 • 2 -
communityai/system_identity_remove_preference_openai-v2
Viewer • Updated • 93 • 2 -
communityai/system_identity_adept_preference_v3-corrected
Viewer • Updated • 121 • 2 -
ShenaoZhang/0.01_4iters_bs256_nodpo_full6w_userresponse_dataset
Viewer • Updated • 34.6k • 2 -
Ksgk-fy/alignment-dpo-test2-mode-3
Viewer • Updated • 720 • 2 -
YYYYYYibo/ultrafeedback_binarized_vllm_part_2
Viewer • Updated • 5k • 2 -
YYYYYYibo/ultrafeedback_binarized_minpi_part_2
Viewer • Updated • 5k • 2 -
ReBatch/ultrafeedback_binarized_nl
Viewer • Updated • 61.7k • 2 -
nbalepur/Mnemonic_Preferences_direct_comparison_fixed
Preview • Updated • 2 -
jhmejia/classifai
Viewer • Updated • 99 • 2 -
YYYYYYibo/whatever
Viewer • Updated • 40 • 2 -
communityai/system_identity_adept_preference_omega
Viewer • Updated • 121 • 2 -
YYYYYYibo/eval-dataset-with-score-original
Viewer • Updated • 200 • 2 -
ShenaoZ/0.0001_withdpo_3iters_bs256_511lr_dataset
Viewer • Updated • 44.8k • 2 -
hanyinwang/layer-project-reward-training
Viewer • Updated • 101 • 2 -
vipinkatara/dataset_complete_new
Viewer • Updated • 89.5k • 2 -
YYYYYYibo/eval-dataset-with-score-rank4_plus
Viewer • Updated • 200 • 2 -
vipinkatara/dataset_complete_final
Viewer • Updated • 89.5k • 2 -
ShenaoZ/0.01_withdpo_4iters_bs256_5102lr_misit_dataset
Viewer • Updated • 51.8k • 2 -
YYYYYYibo/ultrafeedback_binarized_epoch_2_left_part_2
Viewer • Updated • 15k • 2 -
ShenaoZ/0.001_withdpo_4iters_bs256_5102lr_dataset
Viewer • Updated • 51.8k • 2 -
ShenaoZ/0.00005_withdpo_4iters_bs256_5102lr_dataset
Viewer • Updated • 51.8k • 2 -
KaggleMasterX/DPO_Test_ORPO
Viewer • Updated • 500 • 2 -
KaggleMasterX/ORPO_5K
Viewer • Updated • 15k • 3 -
ShenaoZ/0.0001_zephyrgemmasft_withdpo_3iters_bs256_555lr_dataset
Viewer • Updated • 24.4k • 2 -
YYYYYYibo/ultrafeedback_binarized_new_train_part_1
Viewer • Updated • 15k • 2 -
YYYYYYibo/ultrafeedback_binarized_new_train_part_3
Viewer • Updated • 15k • 2 -
YYYYYYibo/ultrafeedback_binarized_dataset_offline_pairrm_part0_mini_0
Viewer • Updated • 4.9k • 2 -
YYYYYYibo/ultrafeedback_binarized_dataset_offline_pairrm_part2_mini_2
Viewer • Updated • 5.18k • 2 -
ShenaoZ/0.0001_sft_nodpo_4iters_bs256_555lr_dataset
Viewer • Updated • 69.1k • 2 -
ShenaoZ/0.0001_sft_nodpo_5iters_bs256_555lr_dataset
Viewer • Updated • 71.1k • 2 -
ShenaoZ/0.001_sft_nodpo_3iters_bs256_531lr_dataset
Viewer • Updated • 67.1k • 2 -
ShenaoZ/0.001_withdpo_4iters_bs256_531lr_dataset
Viewer • Updated • 51.8k • 2 -
YYYYYYibo/ultrafeedback_binarized_doff_no_golden_train_part_2_mini_3
Viewer • Updated • 4.78k • 2 -
ShenaoZ/0.0001_sft_nodpo_3iters_bs256_5102lr_dataset
Viewer • Updated • 67.1k • 2 -
ShenaoZ/0.0001_withdpo_5iters_bs256_5102lr_dataset
Viewer • Updated • 56.9k • 2 -
YYYYYYibo/ultrafeedback_binarized_doff_no_golden_train_part_3_mini_2
Viewer • Updated • 5.18k • 2 -
YYYYYYibo/ultrafeedback_binarized_doff_no_golden_train_part_3
Viewer • Updated • 20.7k • 2 -
YYYYYYibo/ultrafeedback_binarized_doff_real_no_golden_vllm_part_3_mini_2
Viewer • Updated • 4.98k • 2 -
YYYYYYibo/ultrafeedback_binarized_doff_real_no_golden_vllm_part_3_mini_3
Viewer • Updated • 5.09k • 2 -
YYYYYYibo/ultrafeedback_binarized_doff_real_no_golden_train_part_3_mini_3
Viewer • Updated • 5.16k • 2 -
YYYYYYibo/ultrafeedback_binarized_doff_real_no_golden_train_part_3_mini_2
Viewer • Updated • 5.16k • 2 -
GENIAC-Team-Ozaki/chatbot-arena-ja-calm2-7b-chat-experimental_deduped_add_generated_text
Viewer • Updated • 12k • 2 -
ShenaoZhang/0.001_zephyr_5551_4iters_bs256_dataset
Viewer • Updated • 51.8k • 2 -
Code-Refinement/dpo-sample-perfect-less
Viewer • Updated • 128 • 2 -
Code-Refinement/dpo-sample-perfect-more
Viewer • Updated • 128 • 2 -
euiyulsong/sciqa_train_ds_random_rejected
Viewer • Updated • 12.7k • 2 -
GENIAC-Team-Ozaki/chatbot-arena-ja-karakuri-lm-8x7b-chat-v0.1-awq
Viewer • Updated • 12.5k • 2 -
mnoukhov/summarize_from_feedback_tldr3_unlabelled_vllm_pythia410m-dpo-tldr_relabel_pythia1b
Viewer • Updated • 107k • 2 -
theGhoul21/irpo-dataset-v3-iteration2
Viewer • Updated • 5.01k • 2 -
JiazhenLiu01/dpo_llama3_362_threeturn
Viewer • Updated • 1.46k • 2 -
JiazhenLiu01/dpo_llama3_362_threeturn_empty_neg
Viewer • Updated • 1.46k • 2 -
mcding-org/CorrectDPO-Eval-DDP_Q0.5B_PP10_beta0.10r0.00rho0.20
Updated • 2 -
mcding-org/CorrectDPO-Eval-DPP_Q0.5B_PP10_beta0.10p0.00pi0.10
Updated • 2 -
mcding-org/CorrectDPO-Eval-DPP_Q0.5B_PP10_beta0.10p0.00pi0.00
Updated • 2 -
mcding-org/CorrectDPO-Eval-DDP_Q0.5B_PP10_beta0.10r0.20rho0.00
Updated • 2 -
mcding-org/CorrectDPO-Eval-DDP_Q0.5B_PP10_beta0.10r0.10rho0.20
Updated • 2 -
mcding-org/CorrectDPO-Eval-DPP_Q0.5B_PP10_beta0.10p0.10pi0.20
Updated • 2 -
mcding-org/CorrectDPO-Eval-DPP_Q0.5B_PP10_beta0.10p0.10pi0.30
Updated • 2 -
mcding-org/CorrectDPO-Eval-DDP_Q0.5B_PP10_beta0.10r0.20rho0.10
Updated • 2 -
mcding-org/CorrectDPO-Eval-DPR_Q0.5B_PP10_beta0.10g0.10gamma0.00
Updated • 2 -
mcding-org/CorrectDPO-Eval-DPR_Q0.5B_PP10_beta0.10g0.10gamma0.10
Updated • 2 -
mcding-org/CorrectDPO-Eval-DPR_Q0.5B_PP10_beta0.10g0.00gamma0.20
Updated • 2 -
mcding-org/CorrectDPO-Eval-DPP_Q0.5B_PP10_beta0.10p0.20pi0.20
Updated • 2 -
mcding-org/CorrectDPO-Eval-DPP_Q0.5B_PP10_beta0.10p0.20pi0.30
Updated • 2 -
mcding-org/CorrectDPO-Eval-DDP_Q0.5B_PP10_beta0.10r0.30rho0.20
Updated • 2 -
mcding-org/CorrectDPO-Eval-DDP_Q0.5B_PP10_beta0.10r0.30rho0.30
Updated • 2 -
mcding-org/CorrectDPO-Eval-DPR_Q0.5B_PP10_beta0.10g0.20gamma0.00
Updated • 2 -
mcding-org/CorrectDPO-Eval-DPP_Q0.5B_PP10_beta0.10p0.30pi0.10
Updated • 2 -
mcding-org/CorrectDPO-Eval-DPR_Q0.5B_PP10_beta0.10g0.10gamma0.20
Updated • 2 -
mcding-org/CorrectDPO-Eval-DPP_Q0.5B_PP10_beta0.10p0.30pi0.20
Updated • 2 -
mcding-org/CorrectDPO-Eval-DPP_Q0.5B_PP10_beta0.10p0.00pi0.40
Updated • 2 -
mcding-org/CorrectDPO-Eval-DPR_Q0.5B_PP10_beta0.10g0.20gamma0.20
Updated • 2 -
mcding-org/CorrectDPO-Eval-DPP_Q0.5B_PP10_beta0.10p0.20pi0.10
Updated • 2 -
mcding-org/CorrectDPO-Eval-DPP_Q0.5B_PP10_beta0.10p0.10pi0.50
Updated • 2 -
mcding-org/CorrectDPO-Eval-DPP_Q0.5B_PP10_beta0.10p0.10pi0.40
Updated • 2 -
mcding-org/CorrectDPO-Eval-DPR_Q0.5B_PP10_beta0.10g0.20gamma0.30
Updated • 2 -
YYYYYYibo/ultrafeedback_binarized_simple_online_train_part_1_mini_1
Viewer • Updated • 5k • 2 -
mcding-org/CorrectDPO-Eval-DPP_Q0.5B_PP10_beta0.10p0.20pi0.50
Updated • 2 -
mcding-org/CorrectDPO-Eval-DPR_Q0.5B_PP10_beta0.10g0.10gamma0.40
Updated • 2 -
mcding-org/CorrectDPO-Eval-DDP_Q0.5B_PP10_beta0.10r0.50rho0.30
Updated • 2 -
mcding-org/CorrectDPO-Eval-DPR_Q0.5B_PP10_beta0.10g0.00gamma0.30
Updated • 2 -
mcding-org/CorrectDPO-Eval-DPR_Q0.5B_PP10_beta0.10g0.30gamma0.30
Updated • 2 -
mcding-org/CorrectDPO-Eval-DPR_Q0.5B_PP10_beta0.10g0.20gamma0.40
Updated • 2 -
mcding-org/CorrectDPO-Eval-DDP_Q0.5B_PP10_beta0.10r0.50rho0.50
Updated • 2 -
mcding-org/CorrectDPO-Eval-DDP_Q0.5B_PP10_beta0.10r0.30rho0.50
Updated • 2 -
mcding-org/CorrectDPO-Eval-DPR_Q0.5B_PP10_beta0.10g0.30gamma0.40
Updated • 2 -
mcding-org/CorrectDPO-Eval-DDP_Q0.5B_PP10_beta0.10r0.10rho0.40
Updated • 2 -
mcding-org/CorrectDPO-Eval-DDP_Q0.5B_PP10_beta0.10r0.10rho0.50
Updated • 2 -
YYYYYYibo/ultrafeedback_binarized_simple_online_vllm_part_2_mini_2
Viewer • Updated • 5k • 2 -
YYYYYYibo/ultrafeedback_binarized_simple_online_vllm_part_2_mini_0
Viewer • Updated • 5k • 2 -
YYYYYYibo/ultrafeedback_binarized_simple_online_train_part_2_mini_3
Viewer • Updated • 5k • 2 -
YYYYYYibo/ultrafeedback_binarized_simple_online_train_part_3_mini_3
Viewer • Updated • 5.29k • 2 -
mcding-org/CorrectDPO-Dataset-U0
Updated • 2 -
mcding-org/CorrectDPO-Eval-DDP_L8B_U0_beta0.10r0.30rho0.20
Updated • 2 -
Piteryo/count_letters
Viewer • Updated • 1.28k • 2 • 1 -
rafaelsandroni/ultrafeedback_binarized_translated
Viewer • Updated • 1 • 2 -
elfonthefly/STEM_DPO
Viewer • Updated • 1.45M • 9 • 1 -
Piteryo/exact_number_of_sentences
Viewer • Updated • 1.28k • 2 -
GENIAC-Team-Ozaki/tuninig-dataset_pref_20pct_v4_full-sft-finetuned-stage4-iter86000-v4
Viewer • Updated • 19.5k • 2 -
ReBatch/ultrafeedback_nl
Viewer • Updated • 71.4k • 2 -
rajj0/god_sent_datav1
Viewer • Updated • 2.84k • 2 -
sfanm/ultrafeedback_llama3_pad_rm
Viewer • Updated • 56.4k • 2 -
nhyha/ORPO_2
Viewer • Updated • 4 • 2 -
YYYYYYibo/ultrafeedback_binarized_ave_pi_with_golden_train_part_2_mini_3
Viewer • Updated • 5k • 2 -
YYYYYYibo/ultrafeedback_binarized_ave_pi_with_golden_train_part_2_mini_1
Viewer • Updated • 5k • 2 -
minkyungpark/UFB_test
Viewer • Updated • 2k • 2 -
kpriyanshu256/v0-hh-rlhf-train-Hindi-0-20000
Viewer • Updated • 20k • 2 -
mnoukhov/summarize_from_feedback_oai_preprocessing_1706381144_relabel_llama8b
Viewer • Updated • 176k • 2 -
vwxyzjn/sentiment-trl-style
Viewer • Updated • 100 • 2 -
nlee-208/UF-Mistral-Self5
Viewer • Updated • 5k • 2 -
heegyu/Magpie-Pro-DPO-200K-Filtered
Viewer • Updated • 57.1k • 2 -
kashif/nectar_dpo_pairs
Viewer • Updated • 3.84M • 4 • 4 -
We-Want-GPU/yi-ko-DPO-noprompt-dataset
Viewer • Updated • 3.83k • 4 • 2 -
sablo/oasst2_dpo_pairs_en
Viewer • Updated • 5.12k • 2 • 2 -
Deojoandco/reward_model_anthropic_8
Viewer • Updated • 8.55k • 2 • 1 -
FredrikBL/Legal-Snigel-DPO
Viewer • Updated • 2k • 2 • 1 -
nayohan/SentimentSynth-ko
Viewer • Updated • 5.3k • 2 • 1 -
LawChat-tw/RLHF_data
Viewer • Updated • 23.6k • 2 -
cryptom/rm-static
Updated • 4 -
mnoukhov/openai_summarize_vllm_generated_20k
Viewer • Updated • 19.9k • 4 -
dvilasuero/multiturner-for-generation
Viewer • Updated • 3.43k • 4 -
Jaredquek/DpoOlier
Viewer • Updated • 315 • 4 -
vwxyzjn/cai-conversation-dev1705622085
Viewer • Updated • 44.8k • 4 -
vwxyzjn/cai-conversation-dev1705634160
Viewer • Updated • 256 • 4 -
vwxyzjn/cai-conversation-dev1705674984
Viewer • Updated • 256 • 4 -
vwxyzjn/cai-conversation-dev1705675844
Viewer • Updated • 256 • 4 -
weijie210/UFB_preference_iter_0
Viewer • Updated • 15.4k • 2 -
manishiitg/HuggingFaceH4-orca_dpo_pairs
Viewer • Updated • 22.7k • 2 -
pvduy/dpo_data_baai_50k
Viewer • Updated • 54.4k • 2 -
NobodyExistsOnTheInternet/FilteredTruthyDPO
Viewer • Updated • 477 • 2 -
lmg-anon/VNTL-v2.5-1.6k-dpo-pairs
Viewer • Updated • 8.99k • 2 -
vwxyzjn/openhermes-dev__mistralai_Mixtral-8x7B-Instruct-v0.1__1706888126
Viewer • Updated • 84 • 2 -
alvarobartt/orca_dpo_pairs_openai
Viewer • Updated • 12.9k • 2 -
vwxyzjn/openhermes-dev__mistralai_Mixtral-8x7B-Instruct-v0.1__temp
Viewer • Updated • 600k • 2 -
mesolitica/DPO-filtered-aya_dataset-zsm
Viewer • Updated • 10.1k • 2 -
nz/losest_to_3000_range_1000_to_9000
Viewer • Updated • 11k • 2 -
Baidicoot/dpo_safety_ihy_llama
Viewer • Updated • 5k • 2 -
kyujinpy/Mistral-EN-DPO-9K
Viewer • Updated • 9.18k • 2 -
vwxyzjn/ultrafeedback_binarized_1710204240
Viewer • Updated • 24.9k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-preference-64-nsample-2_filter_gold_thr_0.5_self_70m
Viewer • Updated • 37.9k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_160m_bo2_100_kl_0.1_prm_160m_thr_0.1_seed_1
Viewer • Updated • 568k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_160m_bo2_100_kl_0.1_prm_160m_thr_0.3_seed_2
Viewer • Updated • 568k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_160m_bo16_2_mix_50_kl_0.1_prm_160m_thr_0.3_seed_1
Viewer • Updated • 568k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.0_seed_2
Viewer • Updated • 568k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.3_seed_2
Viewer • Updated • 568k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_1.4b_bo16_2_64_mix_50_kl_0.1_prm_160m_thr_0.1_seed_3
Viewer • Updated • 568k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_1.4b_bo2_100_kl_0.1_prm_160m_thr_0.1_seed_1
Viewer • Updated • 189k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_1.4b_bo2_100_kl_0.1_prm_160m_thr_0.3_seed_3
Viewer • Updated • 189k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.0_seed_1_t_1.0
Viewer • Updated • 568k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_1.0_seed_1_t_1.0
Viewer • Updated • 568k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_160m_thr_0.0_seed_3_t_1.0
Viewer • Updated • 568k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.5_seed_1_t_1.0
Viewer • Updated • 568k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.0_seed_3_t_0.75
Viewer • Updated • 568k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.0_seed_1_tp_0.3
Viewer • Updated • 568k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.0_seed_1_tp_0.5
Viewer • Updated • 568k • 2 -
Mitsuki-Sakamoto/fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_1.0_seed_1_t_1.0_eval
Viewer • Updated • 568k • 2 -
Mitsuki-Sakamoto/fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.5_seed_2_t_1.0_eval
Viewer • Updated • 568k • 2 -
Mitsuki-Sakamoto/fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.3_seed_3_t_1.0_eval
Viewer • Updated • 568k • 2 -
ShenaoZhang/0.001_idpo_4iters_dataset
Viewer • Updated • 51.8k • 2 -
mnoukhov/summarize_from_feedback_tldr3_generated_20k_relabel_pythia1b_dpo_temp0.7
Viewer • Updated • 20k • 2 -
Joyqiuyue/lima-preference_dataset-2
Viewer • Updated • 1 • 2 -
ShenaoZ/0.001_idpo_same_scratch_ref_dataset
Viewer • Updated • 63.1k • 2 -
AY2324S2-CS4248-Team-47/gec-dpo-ultrafeedback
Viewer • Updated • 2k • 2 -
when2rl/truthy-dpo-v0.1_reformatted
Viewer • Updated • 1.02k • 2 -
ShenaoZ/0.001_ablation_6iters_dataset
Viewer • Updated • 48.8k • 2 -
ShenaoZ/0.001_ablation_4iters_bs256_dataset
Viewer • Updated • 51.8k • 2 -
orpo-explorers/OHP-Stratified-3
Viewer • Updated • 331k • 2 -
waadarsh/test-orpo-magnite
Viewer • Updated • 214 • 1 -
ShenaoZ/0.001_ablation_5iters_bs256_useresponse_dataset
Viewer • Updated • 56.9k • 2 -
ShenaoZ/0.001_4iters_bs256_nodpo_only2third_userresponse_dataset
Viewer • Updated • 12.2k • 2 -
ShenaoZhang/0.001_4iters_bs256_nodpo_only4w_dataset
Viewer • Updated • 62k • 2 -
YYYYYYibo/ultrafeedback_binarized_phase_2_part_1
Viewer • Updated • 100 • 2 -
dmvaldman/showerthought_preferences_full
Viewer • Updated • 26.1k • 2 -
communityai/system_identity_adept_preference_v3
Viewer • Updated • 121 • 2 -
communityai/system_identity_remove_preference_alibaba_cloud-v2
Viewer • Updated • 93 • 2 -
communityai/system_identity_remove_preference_google-v2
Viewer • Updated • 93 • 2 -
kurier-digital/llm_titles_orpo
Viewer • Updated • 15.2k • 2 -
nbalepur/Mnemonic_Preferences_ours_with_ties_fixed
Preview • Updated • 2 -
ShenaoZ/0.0001_withdpo_4iters_bs256_531lr_dataset
Viewer • Updated • 51.8k • 2 -
YYYYYYibo/ultrafeedback_binarized_left_part_3
Viewer • Updated • 15k • 2 -
ShenaoZ/0.001_withdpo_4iters_bs256_432lr_dataset
Viewer • Updated • 51.8k • 2 -
ShenaoZ/0.0001_withdpo_3iters_bs256_551lr_misit_dataset
Viewer • Updated • 44.8k • 2 -
YYYYYYibo/ultrafeedback_binarized_epoch_2_vllm_part_3
Viewer • Updated • 5k • 2 -
YYYYYYibo/ultrafeedback_binarized_rank4_all_minpi_part_2
Viewer • Updated • 18.6k • 2 -
YYYYYYibo/ultrafeedback_binarized_real_rank4_all_train_part_2
Viewer • Updated • 18.6k • 2 -
YYYYYYibo/ultrafeedback_binarized_real_rank4_all_train_part_3
Viewer • Updated • 20.5k • 2 -
YYYYYYibo/ultrafeedback_binarized_dataset_offline_pairrm_part0_mini_3
Viewer • Updated • 4.9k • 2 -
Tachi67/mnlp_dpo_data
Viewer • Updated • 25.4k • 2 -
YYYYYYibo/ultrafeedback_binarized_rank4_on_vanilla_part_2
Viewer • Updated • 20k • 2 -
euiyulsong/generated_data_all_cos_500
Viewer • Updated • 500 • 2 -
mcding-org/CorrectDPO-Eval-DDP_Q0.5B_PP10_beta0.10r0.10rho0.30
Updated • 2 -
mcding-org/CorrectDPO-Eval-DPR_Q0.5B_PP10_beta0.10g0.20gamma0.10
Updated • 2 -
mcding-org/CorrectDPO-Eval-DDP_Q0.5B_PP10_beta0.10r0.50rho0.20
Updated • 2 -
YYYYYYibo/ultrafeedback_binarized_simple_online_train_part_1_mini_0
Viewer • Updated • 5k • 2 -
mcding-org/CorrectDPO-Eval-DDP_Q0.5B_PP10_beta0.10r0.40rho0.30
Updated • 2 -
mcding-org/CorrectDPO-Eval-DDP_Q0.5B_PP10_beta0.10r0.20rho0.40
Updated • 2 -
thewordsmiths/stem_dpo
Viewer • Updated • 50k • 2 -
BahaaEldin0/openai_summarize_comparisons_dataset_with_prompts
Viewer • Updated • 260k • 2 -
ShenaoZ/SELM-Zephyr-7Bz-dataset
Viewer • Updated • 51.8k • 2 -
nhyha/ORPO
Viewer • Updated • 17 • 2 -
YYYYYYibo/ultrafeedback_binarized_ave_pi_with_golden_vllm_part_3_mini_1
Viewer • Updated • 5.28k • 2 -
YYYYYYibo/gshf_vllm_1_part_2_mini_7
Viewer • Updated • 2.5k • 2 -
YYYYYYibo/gshf_vllm_1_part_2_mini_1
Viewer • Updated • 2.5k • 2 -
YYYYYYibo/gshf_vllm_1_part_2_mini_0
Viewer • Updated • 2.5k • 2 -
YYYYYYibo/gshf_vllm_1_part_2_mini_5
Viewer • Updated • 2.5k • 2 -
YYYYYYibo/gshf_vllm_1_part_2_mini_6
Viewer • Updated • 2.5k • 2 -
YYYYYYibo/gshf_vllm_1_part_2_mini_2
Viewer • Updated • 2.5k • 2 -
YYYYYYibo/gshf_vllm_1_part_2_mini_3
Viewer • Updated • 2.5k • 2 -
YYYYYYibo/gshf_vllm_1_part_2_mini_4
Viewer • Updated • 2.5k • 2 -
YYYYYYibo/gshf_vllm_2_part_2_mini_3
Viewer • Updated • 2.5k • 2 -
YYYYYYibo/gshf_vllm_2_part_2_mini_1
Viewer • Updated • 2.5k • 2 -
YYYYYYibo/gshf_vllm_2_part_2_mini_5
Viewer • Updated • 2.5k • 2 -
YYYYYYibo/gshf_vllm_2_part_2_mini_4
Viewer • Updated • 2.5k • 2 -
YYYYYYibo/gshf_vllm_2_part_2_mini_6
Viewer • Updated • 2.5k • 2 -
YYYYYYibo/gshf_vllm_2_part_2_mini_2
Viewer • Updated • 2.5k • 2 -
YYYYYYibo/gshf_vllm_2_part_2_mini_0
Viewer • Updated • 2.5k • 2 -
YYYYYYibo/gshf_vllm_2_part_2_mini_7
Viewer • Updated • 2.5k • 2 -
YYYYYYibo/gshf_train_part_2_mini_7
Viewer • Updated • 2.5k • 2 -
YYYYYYibo/gshf_train_part_2_mini_3
Viewer • Updated • 2.5k • 2 -
YYYYYYibo/gshf_train_part_2_mini_6
Viewer • Updated • 2.5k • 2 -
YYYYYYibo/gshf_train_part_2_mini_4
Viewer • Updated • 2.5k • 2 -
YYYYYYibo/gshf_train_part_2_mini_0
Viewer • Updated • 2.5k • 2 -
YYYYYYibo/gshf_train_part_2_mini_1
Viewer • Updated • 2.5k • 2 -
YYYYYYibo/gshf_train_part_2_mini_5
Viewer • Updated • 2.5k • 2 -
YYYYYYibo/gshf_train_part_2_mini_2
Viewer • Updated • 2.5k • 2 -
Columbia-NLP/DPO-UltraFeedback_binarized
Viewer • Updated • 62.7k • 2 -
nlee-208/UF-Mistral-Self1
Viewer • Updated • 5k • 2 -
YYYYYYibo/ultrafeedback_binarized_imp_sam_vllm_part_2
Viewer • Updated • 19.1k • 2 -
YYYYYYibo/ultrafeedback_binarized_imp_sam_minpi_2_part_2
Viewer • Updated • 19.1k • 2 -
stojchet/dpo-10K_py_base
Viewer • Updated • 1.54k • 2 -
YYYYYYibo/ultrafeedback_binarized_gshf_lora_train_part_2
Viewer • Updated • 20k • 2 -
GokhanAI/Synthetic
Viewer • Updated • 26.4k • 4 • 1 -
AlekseyKorshuk/hh-rlhf-pairwise
Viewer • Updated • 81.4k • 100 -
AlekseyKorshuk/lmeh-story-cloze-2016
Viewer • Updated • 1k • 2 -
LanXiu/test_dataset
Viewer • Updated • 768 • 2 -
mnoukhov/openai_summarize_comparisons_tldrprompt
Viewer • Updated • 260k • 4 -
vwxyzjn/cai-conversation-prod-h4
Viewer • Updated • 169k • 4 -
vwxyzjn/cai-conversation-dev
Viewer • Updated • 76 • 4 -
vwxyzjn/cai-conversation-dev1704834920
Viewer • Updated • 128 • 4 -
HuggingFaceH4/grok-conversation-harmless-old
Viewer • Updated • 44.8k • 3 -
lamhieu/itorca_dpo_en
Viewer • Updated • 5.92k • 6 -
vwxyzjn/cai-conversation-dev1705620799
Viewer • Updated • 256 • 4 -
vwxyzjn/cai-conversation-dev1705628758
Viewer • Updated • 256 • 4 -
vwxyzjn/cai-conversation-dev1705632182
Viewer • Updated • 256 • 4 -
thangvip/reward-training-data
Viewer • Updated • 2.97k • 4 -
Asap7772/ultrafeedback_binarized_relabelled_test
Viewer • Updated • 32 • 2 -
diyali95916/ultrafeedback_binarized
Viewer • Updated • 187k • 4 -
pvduy/dpo_data_math
Viewer • Updated • 6.81k • 2 -
dkshjn/processed_truthy
Viewer • Updated • 1.02k • 2 -
weijie210/UFB_prefs_iter_0_pairwise
Viewer • Updated • 14.7k • 2 -
vwxyzjn/openhermes-dev__kaist-ai_prometheus-13b-v1.0__1707406405
Viewer • Updated • 167 • 2 -
vwxyzjn/ultrafeedback_binarized_1707919621
Viewer • Updated • 2k • 2 -
mnoukhov/openai_summarize_generated_20k_relabel_pythia410m-dpo1_margin
Viewer • Updated • 20k • 2 -
roleplay4fun/chai-invalid-pairs-ss5-v1.0
Viewer • Updated • 16.1k • 2 -
datatab/ultrafeedback_binarized_serbian
Viewer • Updated • 189k • 2 -
David-Xu/astronomy-stack-dpo
Viewer • Updated • 19.9k • 2 -
quirky-lats-at-mats/NORMAL_BACKDOOR_alpaca_sleeper_agents_toy_safety_v4
Viewer • Updated • 2.83k • 2 -
aengusl/noise5_alpaca_sleeper_agents_toy_safety_NOT_TRUNCATED_v4
Viewer • Updated • 2.83k • 2 -
vwxyzjn/tldr-preference-trl-style
Viewer • Updated • 100 • 31 -
Aditya685/hermes_preference_filtered_data
Viewer • Updated • 78.4k • 2 -
Ksgk-fy/alignment-dpo-test03
Viewer • Updated • 3.78k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_160m_thr_0.0_seed_1_t_1.0
Viewer • Updated • 568k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.0_seed_1_t_0.75
Viewer • Updated • 568k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.0_seed_3_t_0.25
Viewer • Updated • 568k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.0_seed_2_tp_0.1
Viewer • Updated • 568k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.0_seed_2_tp_0.7
Viewer • Updated • 568k • 2 -
Mitsuki-Sakamoto/fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.0_seed_2_t_1.0_eval
Viewer • Updated • 568k • 2 -
ShenaoZhang/0.001_idpo_same_dataset
Viewer • Updated • 44.8k • 2 -
ShenaoZhang/0.001_idpo_4iters_ref_response
Viewer • Updated • 51.8k • 2 -
mnoukhov/summarize_from_feedback_tldr3_generated_20k_vllm_pythia1b_dpo_temp0.7_length128
Viewer • Updated • 20k • 2 -
guoyu-zhang/shp_4
Viewer • Updated • 1k • 2 -
guoyu-zhang/usp_3
Viewer • Updated • 1k • 2 -
ShenaoZ/0.00001_ablation_dataset
Viewer • Updated • 44.8k • 2 -
mnoukhov/summarize_from_feedback_tldr3_labelled_generated_relabel_20k_dpo_costa_1b_fp16.yml_3d94f50_b9ff2
Viewer • Updated • 9.5k • 2 -
ShenaoZ/0.001_ablation_declr_4iters_dataset
Viewer • Updated • 51.8k • 2 -
mnoukhov/summarize_from_feedback_tldr3_unlabelled_vllm_dpo2_costa_1b_fp16.yml_bfcef
Viewer • Updated • 107k • 2 -
orpo-explorers/OHP-Stratified-2
Viewer • Updated • 331k • 2 -
ShenaoZ/001_ablation_5iters_bs256_nodpo_dataset
Viewer • Updated • 58.9k • 2 -
ShenaoZ/0.001_ablation_4iters_bs256_sample2_dataset
Viewer • Updated • 51.8k • 2 -
ShenaoZ/01_ablation_3iters_bs256_nodpo_dataset
Viewer • Updated • 24.4k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.0_seed_2
Viewer • Updated • 303k • 2 -
jjmaxwell/llama3_orpo_dpo_clone
Viewer • Updated • 44.2k • 2 -
communityai/system_identity_remove_preference_phi
Viewer • Updated • 93 • 2 -
communityai/system_identity_remove_preference_coral
Viewer • Updated • 93 • 2 -
communityai/system_identity_remove_preference_qwen_2-v2
Viewer • Updated • 93 • 2 -
YYYYYYibo/eval-dataset-original
Viewer • Updated • 200 • 2 -
YYYYYYibo/eval-dataset-with-score-merge
Viewer • Updated • 200 • 2 -
YYYYYYibo/ultrafeedback_binarized_plus_minpi_part_3
Viewer • Updated • 5k • 2 -
ShenaoZ/0.001_withdpo_4iters_bs256_5102lr_misit_dataset
Viewer • Updated • 19.3k • 2 -
YYYYYYibo/ultrafeedback_binarized_epoch_2_minpi_part_2
Viewer • Updated • 5k • 2 -
ShenaoZ/0.0_withdpo_4iters_bs256_5102lr_misit_dataset
Viewer • Updated • 51.8k • 2 -
StrangeSX/RawdataforAUNQA_TH
Viewer • Updated • 2.06k • 2 -
ShenaoZ/0.0001_zephyrgemmasft_withdpo_4iters_bs256_555lr_dataset
Viewer • Updated • 51.8k • 2 -
YYYYYYibo/ultrafeedback_binarized_dataset_offline_part2
Viewer • Updated • 20.7k • 2 -
YYYYYYibo/ultrafeedback_binarized_dataset_offline_pairrm_part1_mini_0
Viewer • Updated • 4.9k • 2 -
ShenaoZ/0.01_sft_nodpo_3iters_bs256_531lr_dataset
Viewer • Updated • 67.1k • 2 -
YYYYYYibo/ultrafeedback_binarized_doff_no_golden_train_part_2
Viewer • Updated • 19.1k • 2 -
YYYYYYibo/ultrafeedback_binarized_doff_no_golden_vllm_part_3_mini_2
Viewer • Updated • 5.08k • 2 -
YYYYYYibo/ultrafeedback_binarized_doff_no_golden_train_part_3_mini_1
Viewer • Updated • 5.18k • 2 -
YYYYYYibo/ultrafeedback_binarized_doff_real_no_golden_vllm_part_2_mini_3
Viewer • Updated • 5k • 2 -
ShenaoZ/0.0005_betadpoinit_4iters_bs256_5551lr_dataset
Viewer • Updated • 69.1k • 2 -
Baidicoot/anthropic-helpful-harmless-rlhf
Viewer • Updated • 169k • 2 -
mnoukhov/summarize_from_feedback_tldr3_unlabelled_vllm_pythia410m-dpo-tldr-step873_relabel_pythia1b
Viewer • Updated • 20k • 2 -
yananchen/tp_dpo_pairs_45chosen
Viewer • Updated • 3.64k • 2 -
YYYYYYibo/ultrafeedback_binarized_rank4_on_vanilla_part_1
Viewer • Updated • 20k • 2 -
YYYYYYibo/ultrafeedback_binarized_simple_online_vllm_part_1_mini_1
Viewer • Updated • 5k • 2 -
mcding-org/CorrectDPO-Eval-DDP_Q0.5B_PP10_beta0.10r0.10rho0.00
Updated • 2 -
mcding-org/CorrectDPO-Eval-DDP_Q0.5B_PP10_beta0.10r0.00rho0.10
Updated • 2 -
mcding-org/CorrectDPO-Eval-DDP_Q0.5B_PP10_beta0.10r0.00rho0.30
Updated • 2 -
mcding-org/CorrectDPO-Eval-DPR_Q0.5B_PP10_beta0.10g0.00gamma0.10
Updated • 2 -
mcding-org/CorrectDPO-Eval-DPP_Q0.5B_PP10_beta0.10p0.10pi0.10
Updated • 2 -
mcding-org/CorrectDPO-Eval-DDP_Q0.5B_PP10_beta0.10r0.30rho0.10
Updated • 2 -
mcding-org/CorrectDPO-Eval-DPP_Q0.5B_PP10_beta0.10p0.30pi0.30
Updated • 2 -
mcding-org/CorrectDPO-Eval-DPR_Q0.5B_PP10_beta0.10g0.00gamma0.40
Updated • 2 -
mcding-org/CorrectDPO-Eval-DDP_Q0.5B_PP10_beta0.10r0.00rho0.40
Updated • 2 -
YYYYYYibo/ultrafeedback_binarized_simple_online_train_part_2_mini_0
Viewer • Updated • 5k • 2 -
GENIAC-Team-Ozaki/tuninig-dataset_pref_20pct_full-sft-finetuned-stage4-iter86000
Viewer • Updated • 20.3k • 2 -
BahaaEldin0/small_dataset_with_rewards
Viewer • Updated • 1k • 2 -
BahaaEldin0/updated_dataset_with_prompts
Viewer • Updated • 1k • 2 -
BahaaEldin0/openai_summarize_comparisons_dataset_with_prompts_2_percent
Viewer • Updated • 4.69k • 2 -
Tachi67/mnlp_dpo_data_7k
Viewer • Updated • 7.66k • 2 -
stojchet/test_disc_ds
Viewer • Updated • 20 • 2 -
thepowerfuldeez/Qwen-summarize-dataset-test
Viewer • Updated • 187 • 2 -
Marjovl/berkeley-nest-Nectar-DPO
Viewer • Updated • 1.1M • 2 • 1 -
nlee-208/UF1000-eurus
Viewer • Updated • 1k • 2 -
heli-stand/hh-rlhf-harmless-base-trl-style
Viewer • Updated • 44.8k • 559 -
YYYYYYibo/full_simple_online_vllm_part_2_mini_1
Viewer • Updated • 2.5k • 2 -
YYYYYYibo/full_simple_online_vllm_part_2_mini_7
Viewer • Updated • 2.3k • 2 -
YYYYYYibo/full_simple_online_vllm_part_2_mini_6
Viewer • Updated • 2.3k • 2 -
YYYYYYibo/full_simple_online_vllm_part_2_mini_5
Viewer • Updated • 2.1k • 2 -
YYYYYYibo/full_simple_online_vllm_part_2_mini_0
Viewer • Updated • 2.5k • 2 -
YYYYYYibo/full_simple_online_vllm_part_2_mini_3
Viewer • Updated • 2.5k • 2 -
YYYYYYibo/full_simple_online_vllm_part_2_mini_4
Viewer • Updated • 2.3k • 2 -
YYYYYYibo/full_simple_online_vllm_part_2_mini_2
Viewer • Updated • 2.5k • 2 -
YYYYYYibo/full_simple_online_train_part_2_mini_6
Viewer • Updated • 2.38k • 2 -
YYYYYYibo/full_simple_online_train_part_2_mini_7
Viewer • Updated • 2.38k • 2 -
YYYYYYibo/full_simple_online_train_part_2_mini_0
Viewer • Updated • 2.38k • 2 -
YYYYYYibo/full_simple_online_train_part_2_mini_2
Viewer • Updated • 2.38k • 2 -
YYYYYYibo/full_simple_online_train_part_2_mini_3
Viewer • Updated • 2.38k • 2 -
YYYYYYibo/full_simple_online_train_part_2_mini_4
Viewer • Updated • 2.38k • 2 -
YYYYYYibo/full_simple_online_train_part_2_mini_1
Viewer • Updated • 2.38k • 2 -
YYYYYYibo/full_simple_online_train_part_2_mini_5
Viewer • Updated • 2.38k • 2 -
YYYYYYibo/full_simple_online_vllm_part_3_mini_1
Viewer • Updated • 2.44k • 2 -
YYYYYYibo/full_simple_online_vllm_part_3_mini_6
Viewer • Updated • 2.54k • 2 -
YYYYYYibo/full_simple_online_vllm_part_3_mini_0
Viewer • Updated • 2.34k • 2 -
YYYYYYibo/full_simple_online_vllm_part_3_mini_5
Viewer • Updated • 2.04k • 2 -
YYYYYYibo/full_simple_online_vllm_part_3_mini_3
Viewer • Updated • 2.64k • 2 -
YYYYYYibo/full_simple_online_vllm_part_3_mini_2
Viewer • Updated • 2.64k • 2 -
YYYYYYibo/full_simple_online_vllm_part_3_mini_7
Viewer • Updated • 2.25k • 2 -
YYYYYYibo/full_simple_online_vllm_part_3_mini_4
Viewer • Updated • 2.44k • 2 -
YYYYYYibo/full_simple_online_train_part_3_mini_0
Viewer • Updated • 2.42k • 2 -
YYYYYYibo/full_simple_online_train_part_3_mini_6
Viewer • Updated • 2.42k • 2 -
YYYYYYibo/full_simple_online_train_part_3_mini_1
Viewer • Updated • 2.42k • 2 -
YYYYYYibo/full_simple_online_train_part_3_mini_7
Viewer • Updated • 2.42k • 2 -
YYYYYYibo/full_simple_online_train_part_3_mini_3
Viewer • Updated • 2.42k • 2 -
YYYYYYibo/full_simple_online_train_part_3_mini_2
Viewer • Updated • 2.42k • 2 -
YYYYYYibo/full_simple_online_train_part_3_mini_5
Viewer • Updated • 2.42k • 2 -
YYYYYYibo/full_simple_online_train_part_3_mini_4
Viewer • Updated • 2.42k • 2 -
YYYYYYibo/gshf_vllm_1_part_3_mini_0
Viewer • Updated • 2.64k • 2 -
YYYYYYibo/gshf_vllm_1_part_3_mini_2
Viewer • Updated • 2.64k • 2 -
YYYYYYibo/gshf_vllm_1_part_3_mini_6
Viewer • Updated • 2.64k • 2 -
YYYYYYibo/gshf_vllm_1_part_3_mini_5
Viewer • Updated • 2.64k • 2 -
YYYYYYibo/gshf_vllm_1_part_3_mini_1
Viewer • Updated • 2.64k • 2 -
YYYYYYibo/gshf_vllm_1_part_3_mini_3
Viewer • Updated • 2.64k • 2 -
YYYYYYibo/gshf_vllm_1_part_3_mini_7
Viewer • Updated • 2.65k • 2 -
YYYYYYibo/gshf_vllm_1_part_3_mini_4
Viewer • Updated • 2.64k • 2 -
YYYYYYibo/gshf_vllm_2_part_3_mini_2
Viewer • Updated • 2.64k • 2 -
YYYYYYibo/gshf_vllm_2_part_3_mini_1
Viewer • Updated • 2.64k • 2 -
YYYYYYibo/gshf_vllm_2_part_3_mini_6
Viewer • Updated • 2.64k • 2 -
YYYYYYibo/gshf_vllm_2_part_3_mini_5
Viewer • Updated • 2.64k • 2 -
YYYYYYibo/gshf_vllm_2_part_3_mini_0
Viewer • Updated • 2.64k • 2 -
YYYYYYibo/gshf_vllm_2_part_3_mini_3
Viewer • Updated • 2.64k • 2 -
YYYYYYibo/gshf_vllm_2_part_3_mini_7
Viewer • Updated • 2.65k • 2 -
YYYYYYibo/gshf_vllm_2_part_3_mini_4
Viewer • Updated • 2.64k • 2 -
YYYYYYibo/gshf_train_part_3_mini_0
Viewer • Updated • 2.64k • 2 -
YYYYYYibo/gshf_train_part_3_mini_1
Viewer • Updated • 2.64k • 2 -
YYYYYYibo/gshf_train_part_3_mini_6
Viewer • Updated • 2.64k • 2 -
YYYYYYibo/gshf_train_part_3_mini_3
Viewer • Updated • 2.64k • 2 -
YYYYYYibo/gshf_train_part_3_mini_5
Viewer • Updated • 2.64k • 2 -
YYYYYYibo/gshf_train_part_3_mini_2
Viewer • Updated • 2.64k • 2 -
YYYYYYibo/gshf_train_part_3_mini_4
Viewer • Updated • 2.64k • 2 -
YYYYYYibo/gshf_train_part_3_mini_7
Viewer • Updated • 2.65k • 2 -
Columbia-NLP/DPO-distilabel-intel-orca-dpo-pairs_cleaned
Viewer • Updated • 12.8k • 2 -
Columbia-NLP/DPO-py-dpo-v0.1
Viewer • Updated • 9.47k • 2 -
nlee-208/UF-Mistral-Self3
Viewer • Updated • 5k • 2 -
nlee-208/UF-Mistral-Self4
Viewer • Updated • 5k • 2 -
nlee-208/UF-Mistral-Self13
Viewer • Updated • 917 • 2 -
nlee-208/UF-Mistral-Self6
Viewer • Updated • 5k • 2 -
nlee-208/UF-Mistral-Self101
Viewer • Updated • 2.5k • 2 -
nlee-208/UF-Mistral-Self8
Viewer • Updated • 5k • 2 -
nlee-208/UF-Mistral-Self100
Viewer • Updated • 2.5k • 2 -
nlee-208/UF-Mistral-Self11
Viewer • Updated • 5k • 2 -
YYYYYYibo/ultrafeedback_binarized_imp_sam_minpi_1_part_2
Viewer • Updated • 19.1k • 2 -
nlee-208/UF-Mistral-Self10
Viewer • Updated • 5k • 2 -
nlee-208/UF-Mistral-Self9
Viewer • Updated • 5k • 2 -
nlee-208/UF-Mistral-Self12
Viewer • Updated • 5k • 2 -
nlee-208/UF-Mistral-Self7
Viewer • Updated • 5k • 2 -
YYYYYYibo/ultrafeedback_binarized_imp_sam_vllm_part_3
Viewer • Updated • 19.6k • 2 -
YYYYYYibo/ultrafeedback_binarized_imp_sam_minpi_1_part_3
Viewer • Updated • 19.6k • 2 -
YYYYYYibo/ultrafeedback_binarized_imp_sam_minpi_2_part_3
Viewer • Updated • 19.6k • 2 -
YYYYYYibo/ultrafeedback_binarized_imp_sam_1_vllm_part_2
Viewer • Updated • 19.1k • 2 -
YYYYYYibo/ultrafeedback_binarized_imp_sam_1_minpi_1_part_2
Viewer • Updated • 19.1k • 2 -
YYYYYYibo/ultrafeedback_binarized_imp_sam_1_minpi_2_part_2
Viewer • Updated • 19.1k • 2 -
YYYYYYibo/ultrafeedback_binarized_imp_sam_1_vllm_part_3
Viewer • Updated • 19.8k • 2 -
YYYYYYibo/ultrafeedback_binarized_imp_sam_1_minpi_1_part_3
Viewer • Updated • 19.8k • 2 -
YYYYYYibo/ultrafeedback_binarized_imp_sam_1_minpi_2_part_3
Viewer • Updated • 19.8k • 2 -
liswei/rm-static-zhTW
Viewer • Updated • 81.4k • 1 • 30 -
pvduy/hh_shp_oa_gpt4_rm_dataset_vicuna_format
Updated • 1 • 1 -
mii-llm/enex-dpo
Viewer • Updated • 2.99k • 2 • 1 -
AlekseyKorshuk/combined-pairwise
Viewer • Updated • 222k • 1 -
pvduy/hh_shp_oa_gpt4_rm_dataset_vicuna_formatoa
Updated • 1 -
amazingvince/full-dpo
Viewer • Updated • 186k • 2 -
mii-llm/cult-dpo
Viewer • Updated • 987 • 2 -
winglian/cortex-dumpster-fire-gemma-v5-crashed
Updated • 1 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-preference-64-nsample-16_filter_gold_thr_0.2_self_70m
Viewer • Updated • 37.9k • 1 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-preference-64-nsample-16_filter_gold_thr_0.1_self_70m
Viewer • Updated • 189k • 1 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-preference-64-nsample-16_filter_gold_thr_0.5_self_70m
Viewer • Updated • 189k • 1 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-preference-64-nsample-16_filter_gold_thr_0.1_self_160m
Updated • 1 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-preference-64-nsample-16_filter_gold_thr_0.5_self_160m
Updated • 1 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-preference-64-nsample-16_filter_gold_thr_0.2_self_160m
Viewer • Updated • 37.9k • 1 -
August4293/Self_Alignment_Preference-Dataset
Viewer • Updated • 4.45k • 2 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-preference-64-nsample-16_filter_gold_thr_0.0_self_70m
Viewer • Updated • 189k • 1 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-preference-64-nsample-16_filter_gold_thr_0.0_self_160m
Viewer • Updated • 189k • 1 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-preference-64-nsample-2_iso_filter_gold_thr_0.5_self_70m
Viewer • Updated • 189k • 1 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-preference-64-nsample-2_iso_filter_gold_thr_0.1_self_70m
Viewer • Updated • 189k • 1 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-preference-64-nsample-2_iso_filter_gold_thr_0.0_self_70m
Viewer • Updated • 189k • 1 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-preference-64-nsample-2_iso_filter_gold_thr_0.1_self_160m
Updated • 1 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-preference-64-nsample-2_iso_filter_gold_thr_0.5_self_160m
Updated • 1 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-preference-64-nsample-2_iso_filter_gold_thr_0.0_self_160m
Updated • 1 -
boopysaur/user1-dpo-small
Viewer • Updated • 12.1k • 1 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-preference-64-nsample-16_filter_gold_thr_0.3_self_160m
Updated • 1 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-preference-64-nsample-16_filter_gold_thr_1.0_self_160m
Updated • 1 -
Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.0_seed_2_t_1.0
Viewer • Updated • 568k • 1 -
Mitsuki-Sakamoto/fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.1_seed_3_t_1.0_eval
Viewer • Updated • 568k • 1 -
Joyqiuyue/lima_preference_dataset
Viewer • Updated • 50 • 1 -
gagan3012/oasis
Viewer • Updated • 2.34M • 1 -
theblackhacker/arc_dpo
Viewer • Updated • 38.6k • 1 -
Dhananjayg22/legal-dpo
Viewer • Updated • 300 • 1 -
ShenaoZ/0.001_3iters_bs256_declr_nodpo_dataset
Viewer • Updated • 44.8k • 2 -
communityai/system_identity_remove_preference_gpt-v2
Viewer • Updated • 93 • 2 -
ShenaoZ/0.01_withdpo_4iters_bs256_531lr_dataset
Viewer • Updated • 51.8k • 2 -
YYYYYYibo/ultrafeedback_binarized_doff_real_no_golden_train_part_2_mini_0
Viewer • Updated • 4.85k • 2 -
crumb/semantic-corruption-t5-v1_1-small
Viewer • Updated • 2.28k • 1 -
crumb/semantic-corruption-t5-v1_1-base
Updated • 1 -
crumb/semantic-corruption-t5-v1_1-large
Updated • 1 -
mnlp-nsoai/dpo-student-preferences
Viewer • Updated • 18.4k • 1 -
iamnguyen/vi-orpo-dpo-mix
Viewer • Updated • 44.2k • 1 -
ContextualAI/ultrabin_clean_max_chosen_rand_rejected_rationalized
Viewer • Updated • 60.9k • 2 -
malteos/translation_test
Viewer • Updated • 10 • 1 -
malteos/translation_test2
Viewer • Updated • 50 • 1 -
nayohan/contextual-dpo-v0.1-ko
Viewer • Updated • 1.37k • 2 -
nayohan/reward-bench-ko
Viewer • Updated • 8.11k • 30 -
Windy/tmp_output_apc
Viewer • Updated • 60 • 2 -
Windy/tmp_output_apc_t1
Viewer • Updated • 60 • 2 -
Windy/tmp_output_apc_t1_noshort
Viewer • Updated • 60 • 2 -
sert121/preference_data_mapped_v8
Viewer • Updated • 960 • 2 -
sert121/preference_data_mapped_v7
Viewer • Updated • 3.2k • 2 -
Mitsuki-Sakamoto/pref_dataset_prompt_hh
Viewer • Updated • 77 • 1 -
Mitsuki-Sakamoto/pref_dataset_pairwise_hh
Viewer • Updated • 79 • 1 -
Mitsuki-Sakamoto/pref_dataset_prompt_ultrafeedback
Viewer • Updated • 28 • 1 -
Mitsuki-Sakamoto/pref_dataset_pairwise_ultrafeedback
Viewer • Updated • 30 • 1 -
Windy/tmp_output_ultr4_t0
Viewer • Updated • 60 • 2 -
Windy/tmp_output_ultr4_t0_top1
Viewer • Updated • 60 • 2 -
August4293/gsm8k_preference_dataset_it_1
Viewer • Updated • 895 • 2 -
August4293/gsm8k_preference_dataset_it_2
Viewer • Updated • 379 • 2 -
Windy/tmp_output_ultr4_t1
Viewer • Updated • 60 • 2 -
Columbia-NLP/DPO-tldr-summarisation-preferences
Viewer • Updated • 177k • 83 -
Columbia-NLP/DPO-PKU-SafeRLHF
Viewer • Updated • 136k • 6 -
Columbia-NLP/DPO-Nectar
Viewer • Updated • 183k • 2 -
Columbia-NLP/DPO-hh-rlhf
Viewer • Updated • 169k • 56 -
Windy/tmp_output_lima_t0
Viewer • Updated • 60 • 2 -
Windy/tmp_output_ultr4_t1_fromsimpt0_rankerthresh4
Viewer • Updated • 60 • 2 -
YYYYYYibo/test_vllm_mini_0
Viewer • Updated • 2.5k • 2 -
Windy/tmp_output_ultraw_t0
Viewer • Updated • 60 • 2 -
Windy/tmp_output_ultr4_t1_simthresh03
Viewer • Updated • 60 • 2 -
Windy/tmp_output_ultr4_t1_simthresh03_rank6
Viewer • Updated • 60 • 2 -
ZhangShenao/gc_binarized_mode_ultrafeedback
Viewer • Updated • 109k • 2 -
flydust/ultrafeedback-labeled
Viewer • Updated • 61.8k • 2 -
YYYYYYibo/test_get_pi
Viewer • Updated • 1k • 2 -
YYYYYYibo/test_pairrm
Viewer • Updated • 21.1k • 2 -
sert121/preference_data_v11_cleaned_filtered
Viewer • Updated • 3.55k • 2 -
sert121/preference_data_v10_cleaned_filtered
Viewer • Updated • 2.38k • 2 -
Windy/ultr4_v3_t1_trlsft_mv1
Viewer • Updated • 99 • 2 -
stojchet/dpo-deepseek-coder-1.3b-base-empty-fn
Viewer • Updated • 5.24k • 2 -
Windy/ultr4_t1_test
Viewer • Updated • 197 • 4 -
Windy/test_simpo
Viewer • Updated • 43 • 2 -
Windy/test_simpo_onraw
Viewer • Updated • 43 • 2 -
Windy/test_simpo_distrib8
Viewer • Updated • 153 • 2 -
Windy/test_simpo_distrib8_onraw
Viewer • Updated • 153 • 2 -
Windy/4rewriter_simpo_distrib4_rankthresh4_onraw
Viewer • Updated • 3.21k • 2 -
growth-cadet/query_rewritting_orpo
Viewer • Updated • 492 • 2 -
stojchet/dpo-final_base_dataset
Viewer • Updated • 37.4k • 3 -
Katayoon/DPO-ONLY-Zephyr-7B-dataset
Viewer • Updated • 51.8k • 2 -
growth-cadet/query_rewritting_orpo_v2
Viewer • Updated • 492 • 2 -
growth-cadet/query_rewritting_orpo_v3
Viewer • Updated • 1.48k • 2 -
growth-cadet/query_rewritting_orpo_v4
Viewer • Updated • 1.48k • 2 -
growth-cadet/query_rewritting_orpo_foo
Viewer • Updated • 90 • 2 -
growth-cadet/query_rewritting_orpo_foo2
Viewer • Updated • 90 • 2 -
growth-cadet/query_rewritting_orpo_v5
Viewer • Updated • 1.48k • 2 -
princeton-nlp/gemma2-ultrafeedback-armorm
Viewer • Updated • 61.5k • 6.19k • 24 -
YYYYYYibo/ultrafeedback_binarized_with_response_full_part0_mini
Viewer • Updated • 2k • 2 -
YYYYYYibo/ultrafeedback_binarized_with_response_full_part1_mini
Viewer • Updated • 2k • 4 -
YYYYYYibo/ultrafeedback_binarized_with_response_full_part2_mini
Viewer • Updated • 2k • 2 -
Windy/ultr4_v3_t1_strict
Viewer • Updated • 8.33k • 2 -
ZhangShenao/avg_gc_fine_ultrafeedback
Viewer • Updated • 97.1k • 2 -
sardinelab/MT-pref
Viewer • Updated • 15.8k • 6 • 1 -
Katayoon/VPO-Zephyr-7B-dataset
Viewer • Updated • 51.8k • 2 -
valerielucro/gsm8k_preference_dataset_incorrect
Viewer • Updated • 5.09k • 2 -
ZhangShenao/newpgc_fine_ultrafeedback
Viewer • Updated • 97.1k • 354 -
GitBag/llama3-ultrafeedback
Viewer • Updated • 61.1k • 2 -
devngho/back-to-base-16k-phi3
Viewer • Updated • 15.9k • 1 -
fdsfdg/rlhf_tldr_npm
Viewer • Updated • 177k • 2 -
fiveflow/ultrasummary_binarized-v0.3
Viewer • Updated • 2.1k • 2 -
Windy/ultr4_t0_rewrite1_noshort
Viewer • Updated • 37k • 2 -
brucewlee1/dpo-harmful-dataset-Qwen_Qwen1.5-1.8B-Chat-4050
Viewer • Updated • 4.46k • 2 -
brucewlee1/dpo-harmful-dataset-allenai_OLMo-7B-SFT-hf-4050
Viewer • Updated • 4.46k • 3 -
Xalphinions/UltraFeedback_with_tie_armorm
Viewer • Updated • 26.6k • 2 -
Xalphinions/UltraFeedback_with_tie_armorm_1e-4
Viewer • Updated • 20.3k • 2 -
redsgnaoh/orcaratgen
Viewer • Updated • 12.9k • 2 • 1 -
redsgnaoh/orcaratspec
Viewer • Updated • 12.4k • 2 • 1 -
Windy/ultr4_v3_10k_t0
Viewer • Updated • 10k • 2 -
Windy/ultr4_v3_10k_t0_lc128
Viewer • Updated • 10k • 2 -
Xalphinions/UltraFeedback_with_tie_armorm_1e-2_non_zero
Viewer • Updated • 22k • 2 -
Baidicoot/trojan-hh-rlhf-golden
Viewer • Updated • 10k • 2 -
Baidicoot/trojan-harmless-rlhf-golden
Viewer • Updated • 10k • 2 -
GitBag/llama3-ultrafeedback-test
Viewer • Updated • 2k • 2 -
LLM-LAT/harmful-dataset
Viewer • Updated • 4.95k • 219 • 3 -
Windy/ultr4_baseline_m0_vs_real
Viewer • Updated • 8.68k • 2 -
Windy/ultr4_v3_10k_t1_lc128
Viewer • Updated • 10k • 2 -
Windy/ultr4_v3_10k_t1_lc256_added
Viewer • Updated • 10k • 2 -
theGhoul21/irpo-dataset-v1-iteration1-gemma2-9B
Viewer • Updated • 20.8k • 2 • 1 -
KamalamSivakumar/pref_learning_sample
Viewer • Updated • 5 • 2 -
Katayoon/VPO-SELM-Zephyr-7B-dataset
Viewer • Updated • 51.8k • 2 -
SiguienteGlobal/orpo-es-v0.0.3
Viewer • Updated • 7.56k • 2 -
Windy/ultr4_v3_10k_t1_lc128_added_nsrewriter
Viewer • Updated • 10k • 2 -
Windy/ultr4_v3_10k_t1_added_nsrewriter
Viewer • Updated • 10k • 2 -
yaswanthchittepu/ultrafeedback-binarized-llama3-8b-standard-margin-data-full
Viewer • Updated • 63.7k • 2 -
sameearif/ultrafeedback-test
Viewer • Updated • 60.9k • 3 -
DuongTrongChi/dpo-unsloth
Viewer • Updated • 14.5k • 2 -
yaswanthchittepu/ultrafeedback-binarized-llama3-8b-pop-margin-data-full
Viewer • Updated • 63.7k • 2 -
Windy/ultr4_v3_10k_t1_added_nsrewriter_rank4
Viewer • Updated • 10k • 2 -
Windy/ultr4_v3_10k_t1_added_nosimirewriter
Viewer • Updated • 10k • 2 -
llmat/dpo-orpo-mix-50k
Viewer • Updated • 54.2k • 7 -
Windy/ultr4_v3_10k_t1_added_nosimirewriter_noshort
Viewer • Updated • 10k • 2 -
jcmei/SELM-Zephyr-7B-dataset
Viewer • Updated • 17.3k • 2 -
doubledsbv/kafka_dpo_v2
Viewer • Updated • 59.9k • 45 -
Windy/rewritert1m0_v3_10k_nosimi
Viewer • Updated • 10k • 2 -
Windy/rewritert1m0_v3_10k_nosimi_noshort
Viewer • Updated • 10k • 2 -
theGhoul21/irpo-dataset-v1-iteration1-llama31-8B
Viewer • Updated • 7.55k • 2 • 1 -
Zhihui/cai-conversation-codegen-dev-mbppplus1721981852
Viewer • Updated • 378 -
mxz/CValues_DPO
Viewer • Updated • 146k • 2 -
Windy/ultr4_v3_10k_t1_added_nosiminoshortrewriter
Viewer • Updated • 10k • 2 -
Windy/rewritert1_v3_10k_nosimi_vsm0
Viewer • Updated • 10k • 2 -
RedaAlami/UsefulSafe-PKU-SafeRLHF
Viewer • Updated • 35k • 2 -
yuhaoo666/preference_dataset
Viewer • Updated • 500 • 2 -
Eli-Rhm/summarization_preference
Viewer • Updated • 1k • 2 -
weqweasdas/comp_bt_N2
Viewer • Updated • 512 • 2 -
weqweasdas/comp_bt_N4
Viewer • Updated • 695 • 2 -
weqweasdas/comp_bt_N8
Viewer • Updated • 836 • 2 -
weqweasdas/comp_pm_N2
Viewer • Updated • 499 • 2 -
weqweasdas/comp_pm_N4
Viewer • Updated • 682 • 2 -
weqweasdas/comp_pm_N8
Viewer • Updated • 862 • 2 -
benchang1110/DPO-Taide
Viewer • Updated • 747k • 2 -
yuhaoo666/new_preference_dataset
Viewer • Updated • 500 • 2 -
Windy/ultr4_v3_t0_negrwt_on_directa
Viewer • Updated • 10k • 4 -
RedaAlami/Useful-PKU-SafeRLHF
Viewer • Updated • 83.4k • 2 -
Windy/rewritert2_v3_10k_vsm0
Viewer • Updated • 10k • 2 -
Windy/rewritert2_v3_10k_vsm0_mixt
Viewer • Updated • 10k • 2 -
scottsuk0306/HelpSteer2-binarized
Viewer • Updated • 7.6k • 275 -
SiguienteGlobal/orpo-es-v0.0.2
Viewer • Updated • 22.4k • 4 -
Windy/ultr4_v3_t0_negrwt_on_rewrite1
Viewer • Updated • 10k • 2 -
Xalphinions/UltraFeedback_with_tie_armorm_1e-2_non_zero_2
Viewer • Updated • 22k • 2 -
chethan-mahindrakar/preference-dataset
Viewer • Updated • 50 • 2 -
Windy/rewritert3_v3_10k_vsm0_mixt
Viewer • Updated • 10k • 2 -
Windy/rewritert3_v3_10k_vsm0
Viewer • Updated • 10k • 2 -
SeniorKabanocci/SHP-binarized
Viewer • Updated • 121k • 33 -
ZhangShenao/newpgc_fine_ultrafeedback_pro_nofilter
Viewer • Updated • 121k • 2 -
Katayoon/VPO-Zephyr-7B-2-dataset
Viewer • Updated • 19.3k • 2 -
Katayoon/VPO-Zephyr-7B-3-dataset
Viewer • Updated • 17.3k • 2 -
TwinDoc/template-dataset-orpo-gpt
Viewer • Updated • 15.4k • 2 -
jcmei/SELM-Llama-3-8B-Instruct-dataset
Viewer • Updated • 67.1k • 2 -
Windy/rewritert3_v3_10k_vsm0_keeplong
Viewer • Updated • 13.7k • 2 -
TwinDoc/template-dataset-dpo-gpt
Viewer • Updated • 15.4k • 2 -
ZhangShenao/newpgc_fine_ultrafeedback_posonly
Viewer • Updated • 49.6k • 2 -
patruff/mistralNemoDPOpairsA
Viewer • Updated • 1.06k • 2 -
Windy/rewritert3_v3_10k_vsm0_prlc
Viewer • Updated • 10k • 2 -
ZhangShenao/newnewpgc_fine_ultrafeedback
Viewer • Updated • 97.1k • 2 -
ZhangShenao/newnewpgc_fine_ultrafeedback_filter
Viewer • Updated • 82.2k • 2 -
ZhangShenao/newpgc_fine_ultrafeedback13
Viewer • Updated • 34.1k • 2 -
Katayoon/DPO-ONLY-Zephyr-7B-2-dataset
Viewer • Updated • 51.8k • 2 -
ZhangShenao/newpgc_fine_ultrafeedback4w
Viewer • Updated • 42k • 2 -
Anvithah/Lima_preference_dataset
Viewer • Updated • 50 • 2 -
llmat/dpo-orpo-mix-40k
Viewer • Updated • 41.4k • 2 -
Shotaro30678/rlhf-RG-trl-style
Viewer • Updated • 1.02k • 2 -
ZhangShenao/new_fine_ultrafeedback_half
Viewer • Updated • 61.5k • 2 -
ZhangShenao/new_fine_ultrafeedback_double
Viewer • Updated • 121k • 2 -
Katayoon/DPO-ONLY-Zephyr-7B-3-dataset
Viewer • Updated • 51.8k • 2 -
ZhangShenao/newpgc_fine_ultrafeedback_2w
Viewer • Updated • 42k • 2 -
yumenghuang/preference_dataset
Viewer • Updated • 50 • 2 -
saffr0n/ccai_australia
Viewer • Updated • 40 • 2 -
AmarNagargoje/preferred_dataset2
Viewer • Updated • 50 • 2 -
ZhangShenao/newpgc_fine_ultrafeedback_implicit
Viewer • Updated • 121k • 2 -
Isotonic/dpo-mix-1
Viewer • Updated • 74.8k • 2 -
ZhangShenao/new_fine_ultrafeedback_samesize
Viewer • Updated • 61.4k • 2 -
Eli-Rhm/Ranked
Viewer • Updated • 10 • 2 -
Zangs3011/intel_orca_dpo_pairs_llama3_format
Viewer • Updated • 12.9k • 3 -
Zangs3011/intel_orca_dpo_pairs_ChatML_format
Viewer • Updated • 12.9k • 2 -
Eli-Rhm/Ranked_100
Viewer • Updated • 100 • 2 -
Eli-Rhm/T5_Vs_SFT_comparison
Viewer • Updated • 100 • 2 -
Eli-Rhm/comparison
Viewer • Updated • 100 • 2 -
Katayoon/VPO-Zephyr-7B-SecondTry-dataset
Viewer • Updated • 51.8k • 2 -
llmat/dpo-orpo-mix-45k
Viewer • Updated • 45k • 2 -
llmat/dpo-orpo-mix-38k-balanced
Viewer • Updated • 38.6k • 6 -
Mitsuki-Sakamoto/sft_hh_harmless_pythia-2.8b-deberta-v3
Viewer • Updated • 44.3k • 1 -
joelb/ccai_scotland
Viewer • Updated • 1.6k • 2 -
Mitsuki-Sakamoto/hh_harmless_re_pref-deberta-v3
Viewer • Updated • 42.5k • 1 -
Mitsuki-Sakamoto/hh_helpful_re_pref-deberta-v3
Viewer • Updated • 43.8k • 1 -
Mitsuki-Sakamoto/sft_hh_helpful_pythia-2.8b-deberta-v3
Viewer • Updated • 45.4k • 1 -
Mitsuki-Sakamoto/sft_hh_harmless_pythia-2.8b-use_response_template-deberta-v3
Viewer • Updated • 42k • 1 -
Eli-Rhm/100_Final
Viewer • Updated • 100 • 2 -
Keetudev18/modified_dataset_4
Viewer • Updated • 50 • 2 -
Shotaro30678/rlhf-RG-trl-style-raw-1024
Viewer • Updated • 1.02k • 2 -
lamm-mit/bioinspired_gpt-4o-mini-dataset_V1_B-cleaned-orpo_dataset_V10_messageformat
Viewer • Updated • 4.93k • 2 -
Shotaro30678/rlhf-RG-trl-style-raw-test
Viewer • Updated • 10 • 2 -
joelb/ccai_jamaica_caribbean
Viewer • Updated • 119 • 2 -
growth-cadet/query_rewritting_orpo_020824
Viewer • Updated • 961 • 2 -
growth-cadet/query_rewritting_orpo_020824v2
Viewer • Updated • 961 • 2 -
ZhangShenao/gc_fine_ultrafeedback_nosys_noinst
Viewer • Updated • 97.1k • 2 -
Katayoon/VPO-Zephyr-7B-0.01-dataset
Viewer • Updated • 51.8k • 2 -
GitBag/llama3-ultrafeedback-20k-iter_1
Viewer • Updated • 22k • 2 -
joelb/ccai_singapore
Viewer • Updated • 103 • 2 -
growth-cadet/query_rewritting_orpo_020824v3
Viewer • Updated • 1.02k • 2 -
Arnab13/lima-preferred
Viewer • Updated • 5 • 2 -
ShubhamNair/preference-dataset-llama2
Viewer • Updated • 200 • 2 -
Mitali11/preference-dataset
Viewer • Updated • 500 • 2 -
GitBag/llama3-ultrafeedback-iter_1
Viewer • Updated • 62k • 2 -
Shotaro30678/rlhf-RG-trl-style-raw-1024-query
Viewer • Updated • 1.02k • 2 -
DhruvParth/Mistral-7B-Instruct-v2.0-PairRM-DPO-Dataset
Viewer • Updated • 50 • 4 -
GitBag/llama3-ultrafeedback-20k-iter_2
Viewer • Updated • 22k • 2 -
Arnab13/lima_preferred
Viewer • Updated • 50 • 2 -
jkkn/Mistral-7B-Instruct-v2.0-Lima-PairRM-DPO-Dataset
Viewer • Updated • 50 • 2 -
Charles95/hh-rlhf
Viewer • Updated • 100 • 2 -
Charles95/sentiment-trl-style
Viewer • Updated • 5.48k • 2 -
Charles95/descriptiveness-trl-style
Viewer • Updated • 5.42k • 2 -
Charles95/tldr-preference-trl-style
Viewer • Updated • 179k • 2 -
Charles95/hh-rlhf-helpful-base-trl-style-apply-chat-template
Viewer • Updated • 100 • 2 -
Windy/llama31_rewritert0_v3_10k_vsm0
Viewer • Updated • 10k • 2 -
GitBag/llama3-ultrafeedback-iter_2
Viewer • Updated • 62k • 2 -
Katayoon/VPO-Zephyr-7B-0.0005-dataset
Viewer • Updated • 51.8k • 2 -
Windy/llama31_rewritert0_v3_10k_vsm0_fx
Viewer • Updated • 10k • 2 -
patruff/mistralNemoDPOpairsB
Viewer • Updated • 1.06k • 2 -
TwinDoc/synthetic-dataset-dpo-gpt-bfsi
Viewer • Updated • 10.3k • 2 -
Mitsuki-Sakamoto/sft_hh_harmless_pythia-1.4b-deberta-v3
Viewer • Updated • 44.3k • 1 -
Mitsuki-Sakamoto/sft_hh_helpful_pythia-1.4b-deberta-v3
Viewer • Updated • 45.4k • 1 -
ryo0634/alert-dpo-ja-4k
Viewer • Updated • 4.36k • 2 -
llm-book/alert-preference-2k-ja
Viewer • Updated • 2k • 17 -
ryo0634/alert_dpo-ja-4.8k
Viewer • Updated • 4.8k • 2 -
Windy/llama3_rewritert0_v3_10k_vsm0_fx
Viewer • Updated • 9.13k • 2 -
Katayoon/VPO-Zephyr-7B-0.05-dataset
Viewer • Updated • 51.8k • 2 -
growth-cadet/query_rewritting_orpo_060824_chatv2
Viewer • Updated • 7.64k • 2 -
growth-cadet/query_rewritting_orpo_060824_chat
Viewer • Updated • 7.64k • 2 -
ORPO/UF-Mistral-Self-w-score-3
Viewer • Updated • 16.9k • 2 -
ORPO/UF-m2-Self3
Viewer • Updated • 16.9k • 2 -
ORPO/UF-m2-SelfCoT3
Viewer • Updated • 16.9k • 2 -
gohsyi/saferlhf-binarized
Viewer • Updated • 83.4k • 2 -
Windy/llama3_rewritert0_v3_10k_vsm0_fxfx
Viewer • Updated • 10k • 2 -
lamm-mit/bio_q_a_for_ORPO
Viewer • Updated • 634 • 2 -
lamm-mit/bio_q_a_for_ORPO_V2
Viewer • Updated • 512 • 2 -
Xalphinions/transformed_long_story_short_no_strip
Viewer • Updated • 17.6k • 1 -
ZhangShenao/newbin_ultrafeedback
Viewer • Updated • 124k • 2 -
Windy/llama3_rewritert0_v3_10k_vsm0_q_ablt002
Viewer • Updated • 5.71k • 2 -
Windy/llama3_rewritert0_v3_10k_vsm0_q_ablt001
Viewer • Updated • 10k • 2 -
Windy/llama3_rewritert0_v3_10k_vsm0_q_ablt
Viewer • Updated • 236 • 2 -
Windy/llama3_rewritert0_v3_10k_vsm0_q_ablt_a_ablt
Viewer • Updated • 10k • 2 -
Windy/llama3_rewritert0_v3_10k_vsm0_q_ablt003
Viewer • Updated • 2.66k • 2 -
Windy/llama3_rewritert0_v3_10k_vsm0_q_ablt000
Viewer • Updated • 10k • 2 -
Windy/llama3_rewritert0_v3_10k_vsm0_q_ablt_a_ablt-all
Viewer • Updated • 54.6k • 2 -
Windy/llama3_rewritert0_v3_10k_vsm0_a_ablt
Viewer • Updated • 10k • 2 -
Windy/llama3_rewritert0_v3_10k_vsm0_a_ablt-all
Viewer • Updated • 54.6k • 2 -
zhenghaoxu/HelpSteer2-trl-style
Viewer • Updated • 10.7k • 2 -
sionic/ko-dpo-mix-7k-trl-style
Viewer • Updated • 6.39k • 33 • 4 -
lamm-mit/magpie-ultra-v0.1-DPO
Viewer • Updated • 50k • 2 • 1 -
nthakur/multilingual-distilabel-intel-orca-dpo-pairs-v0.1
Viewer • Updated • 9.42k • 8 -
nthakur/multilingual-truthy-dpo-pairs-v0.1
Viewer • Updated • 8.41k • 8 -
rasyosef/ultrafeedback-orca-math-dpo
Viewer • Updated • 43.7k • 19 -
yaditi1303/mental_health_preferred_dataset
Viewer • Updated • 10 • 2 -
ihavebraindamage/orpo-dpo-mix-40k-FA
Viewer • Updated • 44.2k • 2 • 1 -
Baidicoot/augmented_advbench_v5
Viewer • Updated • 5k • 6 -
SagarSrinivas/dpo_dataset
Viewer • Updated • 23 • 2 -
Windy/llama3_rewritert0_v3_10k_vsm0_thresh001-all
Viewer • Updated • 20.3k • 2 -
wassname/ethics_qna_preferences
Viewer • Updated • 113k -
wassname/mmlu_dpo
Viewer • Updated • 15.9k • 94 -
Windy/llama3_rewritert0_v3_10k_vsm0_thresh000-all
Viewer • Updated • 27.2k • 2 -
GitBag/llama3-ultrafeedback-20k-iter_1_1723066371
Viewer • Updated • 22k • 2 -
Windy/llama3_rewritert0_v3_10k_vsm0_q_ablt_a_ablt-dropq
Viewer • Updated • 9.99k • 2 -
GitBag/llama3-ultrafeedback-iter_2_1723079513
Viewer • Updated • 63.1k • 2 -
GitBag/llama3-ultrafeedback-pair_6
Viewer • Updated • 63.1k • 2 -
ZhangShenao/gcbinarized_ultrafeedback_nosys
Viewer • Updated • 97.1k • 850 -
jonluj/lowercase_ultrafeedback
Viewer • Updated • 41.6k • 2 -
ZhangShenao/gcbinarized_fine_ultrafeedback
Viewer • Updated • 97.1k • 1.58k -
ZhangShenao/gcmode_fine_ultrafeedback
Viewer • Updated • 97.1k • 2 -
Windy/llama3_rewritert0_v3_10k_vsm0_rank1-002
Viewer • Updated • 10.4k • 2 -
Windy/llama3_rewritert0_v3_10k_vsm0_epoch1-002
Viewer • Updated • 8.45k • 2 -
Windy/llama3_rewritert0_v3_10k_q_ablt_keepneg002
Viewer • Updated • 12.2k • 2 -
Windy/llama3_rewritert0_v3_10k_q_ablt_keepneg000
Viewer • Updated • 33.8k • 2 -
jonluj/lowercase_ultrafeedback_with_reject
Viewer • Updated • 41.6k • 2 -
Shotaro30678/rlhf-RG-trl-style-refined
Viewer • Updated • 1.02k • 2 -
ZhangShenao/gcbinarized_posonly_ultrafeedback
Viewer • Updated • 49.6k • 2 -
ContextualAI/ultrafeedback_clair_32k
Viewer • Updated • 29.1k • 246 • 4 -
gx-ai-architect/helpsteer_combined_pref
Viewer • Updated • 50.7k • 2 -
ContextualAI/ultrafeedback_rlaif_32k
Viewer • Updated • 31.8k • 162 • 1 -
ContextualAI/ultrafeedback_stronger-preferred_32k
Viewer • Updated • 29.1k • 143 • 1 -
ContextualAI/ultrafeedback_rlaif-offpolicy_32k
Viewer • Updated • 29.1k • 131 • 1 -
Windy/llama3_rewritert0_v3_10k_q_ablt_keepnegmixpos
Viewer • Updated • 51.4k • 2 -
simonycl/llama3-ultrafeedback-multi-judge-test
Viewer • Updated • 10 • 2 -
simonycl/llama3-ultrafeedback-annotate-start-0-end-0.25-judge-5
Viewer • Updated • 15k • 2 -
Windy/llama3_rewritert0_v3_10k_q_ablt_keepneg002-gpt4a
Viewer • Updated • 12.1k • 2 -
daidv1112/alignmem
Viewer • Updated • 1.05k • 2 -
gx-ai-architect/helpsteer_hh_combined_pref
Viewer • Updated • 211k • 2 • 1 -
gx-ai-architect/helpsteer_hh_combined_pref_filtered
Viewer • Updated • 211k • 13 -
arcee-train/cleaned-Aya-Command.R-ORPO
Viewer • Updated • 14.2k • 2 -
patruff/mistralNemoDPOpairsC
Viewer • Updated • 1.29k • 2 -
RedaAlami/PKU-SafeRLHF-Processed-simple-responses
Viewer • Updated • 47k • 2 -
Windy/llama3_rewritert0_v3_10k_q_ablt_keepneg002-gpt4a-noshort
Viewer • Updated • 5.78k • 2 -
RedaAlami/PKU-SafeRLHF-Processed
Viewer • Updated • 47.1k • 1.41k -
Windy/llama3base_rewritert0_v3_10k_vsm0-001
Viewer • Updated • 10k • 2 -
Windy/llama3base_rewritert0_v3_10k_vsm0-002
Viewer • Updated • 10k • 2 -
arcee-globe/mixed-argilla-orpo-mix-7k-arabic
Viewer • Updated • 6.75k • 2 -
arcee-ai/cleaned-orpo-dpo-mix-40k
Viewer • Updated • 43.7k • 4 -
Zangs3011/toxic-dpo-v0.2_llama3.1_format
Viewer • Updated • 541 • 1 -
simonycl/llama3-ultrafeedback-annotate-start-0.5-end-0.75-judge-5
Viewer • Updated • 15k • 2 -
simonycl/llama3-ultrafeedback-annotate-start-0.25-end-0.5-judge-5
Viewer • Updated • 15k • 2 -
HanxuHU/llama3-ultrafeedback-annotate-start-0.75-end-1.0-judge-5
Viewer • Updated • 15k • 2 -
simonycl/llama3-ultrafeedback-annotate-judge-5
Viewer • Updated • 61.8k • 2 -
simonycl/ultrafeedback_annotate_start_0_end_0.5_single_judge
Viewer • Updated • 29.9k • 2 -
simonycl/ultrafeedback_annotate_start_0.5_end_1_single_judge
Viewer • Updated • 29.9k • 2 -
simonycl/ultrafeedback_annotate_single_judge
Viewer • Updated • 61.8k • 2 -
Windy/llama3base_rewritert1_v3_10k_vsm0-001
Viewer • Updated • 349 • 2 -
Windy/llama3base_rewritert1_v3_10k_vsm0-001-003
Viewer • Updated • 10k • 2 -
Windy/llama3base_rewritert1_v3_10k_vsm0-001-002
Viewer • Updated • 10k • 2 -
Windy/llama3base_rewritert0_v3_10k_vsm0-001-lc128
Viewer • Updated • 10k • 34 -
Windy/llama3base_rewritert0_v3_10k_vsm0-001-lc64
Viewer • Updated • 99 • 2 -
Windy/llama3base_rewritert0_v3_10k_vsm0-001-lc32
Viewer • Updated • 53 • 2 -
Windy/llama3base_rewritert2_v3_10k_vsm0-001-002
Viewer • Updated • 10k • 2 -
wassname/ethics_expression_preferences
Viewer • Updated • 45.3k -
patruff/mistralNemoDPOpairsD
Viewer • Updated • 881 • 2 -
zake7749/kyara-chinese-preference-rl-dpo-s0-30K
Viewer • Updated • 30.2k • 43 • 1 -
Windy/llama3base_rewritert3_v3_10k_vsm0-001-002
Viewer • Updated • 10k • 2 -
Windy/llama3base_rewritert1_v3_10k_vsm0-001-lc128
Viewer • Updated • 10k • 19 -
Windy/llama3base_rewritert2_v3_10k_vsm0-001-lc128
Viewer • Updated • 10k • 19 -
Windy/llama3base_rewritert3_v3_10k_vsm0-001-lc128
Viewer • Updated • 10k • 19 -
Windy/llama3base_rewritert3_v3_10k_vsm0-001-lc256
Viewer • Updated • 10k • 2 -
yiran-wang3/mistral-sft-iter1-random
Viewer • Updated • 7.81k • 205 -
yiran-wang3/mistral-sft-iter1-eval
Viewer • Updated • 1.25k • 327 -
esfrankel17/HelpSteer_binarized
Viewer • Updated • 34.8k • 114 -
RedaAlami/filtered-magpie-ultra-v0.1
Viewer • Updated • 49.7k • 15 -
RedaAlami/PKU-SafeRLHF-Processed-Reduced_40percent
Viewer • Updated • 18.8k • 110 -
iqwiki-kor/llama-3.1-onpolicy-5samples-rank
Viewer • Updated • 61.6k • 4 -
arcee-globe/arabic-jondurbin-truthy-orpo-v0.1
Viewer • Updated • 920 • 3 -
arcee-globe/arabic-distilabel-capybara-orpo-7k-binarized
Viewer • Updated • 5.4k • 2 -
esfrankel17/HelpSteer2_binarized
Viewer • Updated • 33.1k • 8 -
arcee-globe/arabic-orpo-dpo-mix-40k-filtered
Viewer • Updated • 31.8k • 24 -
TianqiLiuAI/gemma2-ultrafeedback-armorm-add-distance
Viewer • Updated • 59.6k • 326 -
yiran-wang3/mistral-sft-iter1-all
Viewer • Updated • 23.4k • 2 -
yiran-wang3/mistral-sft-iter1-curriculum
Viewer • Updated • 7.81k • 2 -
RedaAlami/PKU-SafeRLHF-Processed-Reduced
Viewer • Updated • 9.42k • 2 -
RedaAlami/PKU-SafeRLHF-20percent
Viewer • Updated • 28.8k • 50 -
RedaAlami/PKU-SafeRLHF-40percent
Viewer • Updated • 38.7k • 34 -
RedaAlami/PKU-SafeRLHF-60percent
Viewer • Updated • 48.6k • 35 -
RedaAlami/PKU-SafeRLHF-80percent
Viewer • Updated • 58.6k • 60 -
RedaAlami/PKU-SafeRLHF-100percent
Viewer • Updated • 68.5k • 18 -
bhujith10/lymsys_datset_for_dpo_training
Viewer • Updated • 78.7k • 8 -
Windy/llama3base_rewritert0_v3_ablt-gpt4vsm0-wfilter
Viewer • Updated • 11.8k • 28 -
Windy/llama3base_rewritert0_v3_ablt-gpt4vsm0-wofilter
Viewer • Updated • 18.2k • 28 -
Shotaro30678/rlhf-RG-trl-style-v2-10
Viewer • Updated • 9 • 2 -
sionic-ai/dpo_hclt
Viewer • Updated • 7.17k • 2 -
Shotaro30678/rlhf-RG-trl-style-v2-improved-score
Viewer • Updated • 1.9k • 9 -
wzhouad/gemma-2-ultrafeedback-hybrid
Viewer • Updated • 61.6k • 3 • 4 -
wzhouad/zephyr-ultrafeedback-hybrid
Viewer • Updated • 64.7k • 2 • 1 -
wzhouad/llama3-ultrafeedback-hybrid
Viewer • Updated • 64.5k • 2 • 2 -
wzhouad/llama3-ultrafeedback-hybrid-v2
Viewer • Updated • 64.5k • 2 • 1 -
wassname/helpsteer2_dpo_nonverbose
Viewer • Updated • 20k • 8 -
simonycl/llama3-ultrafeedback-annotate-start-0.75-end-1.0-judge-5
Viewer • Updated • 15.3k • 2 -
simonycl/llama3.1-ultrafeedback-annotate-start-0.5-end-0.75-judge-5
Viewer • Updated • 15.2k • 2 -
simonycl/llama3.1-ultrafeedback-annotate-start-0.75-end-1.0-judge-5
Viewer • Updated • 15.2k • 2 -
simonycl/llama3.1-ultrafeedback-annotate-start-0-end-0.5-judge-5
Viewer • Updated • 30.3k • 2 -
davanstrien/datasets-tldr-trl-style
Viewer • Updated • 522 • 7 -
Windy/llama3base_rewritert0_v3_ablt-gpt4vsm0-onsft-wfilter
Viewer • Updated • 4.59k • 34 -
yiran-wang3/cleaned-mining-deepseekllm-sft-packing-dpo-binarized
Viewer • Updated • 12.5k • 338 -
fiveflow/ins_dop_dataset
Viewer • Updated • 10.8k • 2 -
fiveflow/raw_pair_with_score
Viewer • Updated • 31.5k • 2 -
lewtun/ultrafeedback
Viewer • Updated • 63.1k • 130 -
minnmamin/hh-rlhf-helpful-base-trl-style
Viewer • Updated • 100 • 2 -
Canarie/hh-rlhf-helpful-base-trl-style
Viewer • Updated • 46.2k • 66 -
wassname/imdb_preferences
Viewer • Updated • 100k -
yiran-wang3/cleaned-mining-deepseekllm-base-all-binarized
Viewer • Updated • 25k • 403 -
wassname/truthful_qa_preferences
Viewer • Updated • 817 -
Shotaro30678/rlhf-RG-trl-style-v3
Viewer • Updated • 1.83k • 7 -
simonycl/aya-23-8B_advprompter_jailbreak
Viewer • Updated • 3.2k • 93 -
simonycl/aya-23-8B_advbench_jailbreak
Viewer • Updated • 520 • 7 -
simonycl/aya-23-8B_advprompter_jailbreak_wth_base
Viewer • Updated • 3.2k • 6 -
wassname/genies_preferences
Viewer • Updated • 118k -
distilabel-internal-testing/clair-test
Viewer • Updated • 10 • 2 • 1 -
kykim0/ultrafeedback_binarized_cleaned_20p
Viewer • Updated • 37.3k • 1.46k -
kykim0/ultrafeedback_binarized_cleaned_50p
Viewer • Updated • 93.2k • 2 -
ZhangShenao/Qwen-relabel-dpo
Viewer • Updated • 122k • 249 -
fiveflow/ins_dpo_dataset_llama
Viewer • Updated • 10.5k • 7 -
gohsyi/ultrafeedback-binarized
Viewer • Updated • 187k • 2 -
simonycl/llama-3.1-metamath_subset_65k-annotate-start-0-end-0.5-judge-5
Viewer • Updated • 32.5k • 2 -
simonycl/llama3.1-ultrafeedback-annotate-judge-5
Viewer • Updated • 62.6k • 77 -
simonycl/llama3.1-ultrafeedback-annotate-armorm-test
Viewer • Updated • 1.98k • 10 -
fiveflow/kd_dpo
Viewer • Updated • 10.5k • 34 -
minnmamin/reward_anthropic
Viewer • Updated • 2.32k • 2 -
Canarie/reward_anthropic
Viewer • Updated • 2.32k • 399 -
lamm-mit/bio-inspired-DPO
Viewer • Updated • 4.93k • 186 -
lamm-mit/spider-silk-DPO
Viewer • Updated • 21.3k • 186 -
ZhangShenao/Gemma-relabel-dpo
Viewer • Updated • 122k • 210 -
ZhangShenao/Gemma-relabel
Viewer • Updated • 122k • 5 -
simonycl/llama3.1-ultrafeedback-annotate-armorm
Viewer • Updated • 62.6k • 120 • 1 -
RedaAlami/PKU-SafeRLHF-Processed-Splits
Viewer • Updated • 47.1k • 2 -
RedaAlami/PKU-SafeRLHF-Processed-Splits_part_1
Viewer • Updated • 9.42k • 5 -
RedaAlami/PKU-SafeRLHF-Processed-Splits_part_2
Viewer • Updated • 9.42k • 5 -
RedaAlami/PKU-SafeRLHF-Processed-Splits_part_3
Viewer • Updated • 9.42k • 5 -
RedaAlami/PKU-SafeRLHF-Processed-Splits_part_4
Viewer • Updated • 9.42k • 5 -
RedaAlami/PKU-SafeRLHF-Processed-Splits_part_5
Viewer • Updated • 9.42k • 5 -
JunxiongWang/llama3-ultrafeedback-armorm
Viewer • Updated • 61.8k • 2 • 1 -
yiran-wang3/cleaned-mining-deepseekcoder67-base-all-binarized
Viewer • Updated • 20.1k • 70 • 1 -
alexchen4ai/phi3_5-ultrafeedback
Viewer • Updated • 61.1k • 32 -
yiran-wang3/cleaned-mining-deepseekllm-base-all-detailed-score-from-error-binarized
Viewer • Updated • 25k • 50 -
RedaAlami/PKU-SafeRLHF-Swept-Split-1
Viewer • Updated • 9.42k • 7 -
RedaAlami/PKU-SafeRLHF-Swept-Split-2
Viewer • Updated • 9.42k • 5 -
RedaAlami/PKU-SafeRLHF-Swept-Split-3
Viewer • Updated • 9.42k • 5 -
RedaAlami/PKU-SafeRLHF-Swept-Split-4
Viewer • Updated • 9.42k • 5 -
RedaAlami/PKU-SafeRLHF-Swept-Split-5
Viewer • Updated • 9.42k • 5 -
RedaAlami/PKU-SafeRLHF-Filtered-Split-1-rho-0.2-phi-0.9
Viewer • Updated • 7.81k • 5 -
RedaAlami/PKU-SafeRLHF-Filtered-Split-2-rho-0.2-phi-0.9
Viewer • Updated • 7.8k • 5 -
RedaAlami/PKU-SafeRLHF-Filtered-Split-3-rho-0.2-phi-0.9
Viewer • Updated • 7.8k • 5 -
RedaAlami/PKU-SafeRLHF-Filtered-Split-4-rho-0.2-phi-0.9
Viewer • Updated • 7.78k • 5 -
RedaAlami/PKU-SafeRLHF-Filtered-Split-5-rho-0.2-phi-0.9
Viewer • Updated • 7.84k • 5 -
RedaAlami/hh-rlhf-safety-sampled-5000-train-500-test
Viewer • Updated • 5.5k • 43 -
simonycl/llama-3.1-metamath_subset_65k-annotate-start-0.5-end-1-judge-5
Viewer • Updated • 32.5k • 2 -
simonycl/llama-3.1-metamath_subset_65k-annotate
Viewer • Updated • 67k • 33 -
nbalepur/saferlhf_pref_full
Viewer • Updated • 3.31k • 6 -
nbalepur/shp_pref_full
Viewer • Updated • 4.36k • 6 -
RedaAlami/dataset0-dataset1
Viewer • Updated • 13.3k • 18 -
RedaAlami/dataset0-dataset1-dataset2
Viewer • Updated • 21.1k • 18 -
RedaAlami/dataset0-dataset1-dataset2-dataset3
Viewer • Updated • 28.9k • 18 -
RedaAlami/dataset0-dataset1-dataset2-dataset3-dataset4
Viewer • Updated • 36.7k • 18 -
RedaAlami/dataset0-dataset1-dataset2-dataset3-dataset4-dataset5
Viewer • Updated • 44.5k • 18 -
HanxuHU/llama-3.1-metamath_subset_65k-annotate-start-0.5-end-1-judge-5
Viewer • Updated • 32.5k • 2 -
Windy/llama3base_rewriter_finalablation_ultra
Viewer • Updated • 20k • 18 -
Windy/llama3base_rewriter_finalablation_selfins
Viewer • Updated • 20k • 18 -
Windy/llama3base_rewriter_finalablation_synpo_20k
Viewer • Updated • 20k • 18 -
Windy/llama3base_rewriter_finalablation_synpo_30k
Viewer • Updated • 30k • 10 -
nbalepur/summary_pref_full
Viewer • Updated • 6.23k • 6 -
yiran-wang3/cleaned-mining-codellama-instruct-base-all-binarized
Viewer • Updated • 26.6k • 72 -
RedaAlami/dataset0_1-dataset1_1-dataset2_1-dataset3_1
Viewer • Updated • 19.7k • 34 -
mlabonne/llmtwin-dpo
Viewer • Updated • 1.63k • 69 • 1 -
Windy/llama3base_best_worst_finalablation_selfins_20k
Viewer • Updated • 20k • 18 -
Windy/llama3base_best_worst_finalablation_ultra_20k
Viewer • Updated • 20k • 18 -
RedaAlami/dataset0_1-dataset1_1
Viewer • Updated • 10.2k • 18 -
RedaAlami/dataset0_1-dataset1_1-dataset2_1
Viewer • Updated • 14.9k • 18 -
RedaAlami/dataset0_1-dataset1_1-dataset2_1-dataset3_1-dataset4_1
Viewer • Updated • 24.4k • 18 -
RedaAlami/dataset0_1-dataset1_1-dataset2_1-dataset3_1-dataset4_1-dataset5_1
Viewer • Updated • 29.1k • 18 -
Windy/llama3base_best_worst_finalablation_synpo_20k
Viewer • Updated • 20k • 18 -
ai2-adapt-dev/ultrafeedback-small
Viewer • Updated • 1k • 143 -
ironman-wow/dpo
Viewer • Updated • 5 • 26 -
simonycl/llama3.1-ultrafeedback-annotate-single-judge
Viewer • Updated • 62.6k • 28 -
allenai/ultrafeedback_binarized_cleaned_train
Viewer • Updated • 61.8k • 789 -
ai2-adapt-dev/webgpt-binarized
Viewer • Updated • 14.3k • 135 -
ai2-adapt-dev/summarize_from_feedback_small
Viewer • Updated • 1k • 145 -
ai2-adapt-dev/summarize_from_feedback
Viewer • Updated • 177k • 3 -
HanxuHU/llama3.1-ultrafeedback-annotate-single-judge
Viewer • Updated • 60.6k • 3 -
RedaAlami/PKU-SafeRLHF-Filtered-Split-1-rho-0.5-phi-0.5
Viewer • Updated • 4.67k • 3 -
RedaAlami/PKU-SafeRLHF-Filtered-Split-2-rho-0.5-phi-0.5
Viewer • Updated • 4.75k • 3 -
RedaAlami/PKU-SafeRLHF-Filtered-Split-3-rho-0.5-phi-0.5
Viewer • Updated • 4.76k • 3 -
RedaAlami/PKU-SafeRLHF-Filtered-Split-4-rho-0.5-phi-0.5
Viewer • Updated • 4.72k • 3 -
RedaAlami/PKU-SafeRLHF-Filtered-Split-5-rho-0.5-phi-0.5
Viewer • Updated • 4.7k • 3 -
Windy/testdata
Viewer • Updated • 25 • 2 -
Windy/llama3base_best_worst_finalablation_selfins_50k
Viewer • Updated • 50k • 2 -
yiran-wang3/cleaned-mining-codellama-python-base-all-binarized
Viewer • Updated • 26.6k • 2 -
Windy/llama3base_rewriter_finalablation_synpo_50k
Viewer • Updated • 50k • 2 -
Windy/llama3base_best_worst_finalablation_ultra_50k
Viewer • Updated • 50k • 2 -
Windy/llama3base_best_worst_finalablation_synpo_50k
Viewer • Updated • 50k • 2 -
nbalepur/mnemonic_pref_full
Viewer • Updated • 358 • 6 -
CoolSpring/morse-code-mistral-dpo
Viewer • Updated • 12.7k • 19 -
RedaAlami/dataset0_2-dataset1_2
Viewer • Updated • 10.7k • 18 -
RedaAlami/dataset0_2-dataset1_2-dataset2_2
Viewer • Updated • 15.8k • 18 -
simonycl/llama-3.1-metamath-annotate-armorm
Viewer • Updated • 67k • 10 -
nbalepur/oasst_pref_full
Viewer • Updated • 1.16k • 10 -
nbalepur/anthropic_pref_full
Viewer • Updated • 1.58k • 8 -
nbalepur/prism_pref_full
Viewer • Updated • 7.79k • 8 -
RedaAlami/PKU-SafeRLHF-Swept-epsilon-0.5-Split-1
Viewer • Updated • 9.42k • 6 -
RedaAlami/PKU-SafeRLHF-Swept-epsilon-0.5-Split-2
Viewer • Updated • 9.42k • 5 -
RedaAlami/PKU-SafeRLHF-Swept-epsilon-0.5-Split-3
Viewer • Updated • 9.42k • 5 -
RedaAlami/PKU-SafeRLHF-Swept-epsilon-0.5-Split-4
Viewer • Updated • 9.42k • 5 -
RedaAlami/PKU-SafeRLHF-Swept-epsilon-0.5-Split-5
Viewer • Updated • 9.42k • 5 -
RedaAlami/PKU-SafeRLHF-Filtered-epsilon-0.5-Split-1-rho-0.2-phi-0.9
Viewer • Updated • 5.16k • 3 -
RedaAlami/PKU-SafeRLHF-Filtered-epsilon-0.5-Split-2-rho-0.2-phi-0.9
Viewer • Updated • 5.17k • 3 -
RedaAlami/PKU-SafeRLHF-Filtered-epsilon-0.5-Split-3-rho-0.2-phi-0.9
Viewer • Updated • 5.2k • 3 -
RedaAlami/PKU-SafeRLHF-Filtered-epsilon-0.5-Split-4-rho-0.2-phi-0.9
Viewer • Updated • 5.2k • 3 -
RedaAlami/PKU-SafeRLHF-Filtered-epsilon-0.5-Split-5-rho-0.2-phi-0.9
Viewer • Updated • 5.12k • 3 -
nbalepur/defeasible-alignment
Viewer • Updated • 24.8k • 99 -
RedaAlami/dataset0_2-dataset1_2-dataset2_2-dataset3_2
Viewer • Updated • 21k • 18 -
RedaAlami/dataset0_2-dataset1_2-dataset2_2-dataset3_2-dataset4_2
Viewer • Updated • 26.2k • 34 -
RedaAlami/dataset0_2-dataset1_2-dataset2_2-dataset3_2-dataset4_2-dataset5_2
Viewer • Updated • 31.4k • 34 -
Aliproject2024/dataset_testing_2206
Viewer • Updated • 11 • 92 -
HanxuHU/Meta-Llama-3.1-70B-Instruct_ultrafeedback_annotate_single_judge_gen.jsonl
Viewer • Updated • 60.6k • 2 -
simonycl/gemma2-9B-it-ultrafeedback-armorm-judge
Viewer • Updated • 61.5k • 78 -
RyanYr/hendrydong_preference_700K
Viewer • Updated • 700k • 9 -
RyanYr/hendrydong_preference_700K_shuffled
Viewer • Updated • 700k • 6 -
mlrun/banking-orpo-new
Viewer • Updated • 42 • 47 -
hatoum/orca_dpo_pairs
Viewer • Updated • 12.9k • 3 -
Gunulhona/open_dpo_merged
Viewer • Updated • 632k • 176 -
alexchen4ai/phi3_5-ultrafeedback-backup
Viewer • Updated • 61.1k • 5 -
ohsuz/dpo-v1
Viewer • Updated • 117k • 1 -
simonycl/Llama-3.1-8B-Instruct-ultrafeedback-rm-annotate
Viewer • Updated • 62.6k • 26 -
HumanLLMs/Humanish-DPO
Viewer • Updated • 8.91k • 16 -
Locutusque/ApolloRP-DPO-v2.0
Viewer • Updated • 10.5k • 34 -
HanxuHU/gemma-2-9b-it_ultrafeedback_annotate_single_judge
Viewer • Updated • 5k • 2 -
HanxuHU/gemma-2-9b-it_ultrafeedback_annotate_start_0.25_end_0.5_single_judge
Viewer • Updated • 5k • 3 -
HanxuHU/gemma-2-9b-it_ultrafeedback_annotate_start_0_end_0.25_single_judge
Viewer • Updated • 5k • 3 -
HanxuHU/llama3.1-ultrafeedback-annotate-start-0.25-end-0.5-judge-5
Viewer • Updated • 5k • 3 -
HanxuHU/gemma-2-9b-it_ultrafeedback_annotate_start_0.5_end_1_single_judge
Viewer • Updated • 10k • 3 -
qgallouedec/hh-rlhf-helpful-base-trl-style
Viewer • Updated • 46.2k • 2 -
yiran-wang3/cleaned-mining-deepseek-llm-python-binarized-gt-replace
Viewer • Updated • 24.6k • 343 -
RedaAlami/dataset0_3-dataset1_3
Viewer • Updated • 14.9k • 18 -
RedaAlami/dataset0_3-dataset1_3-dataset2_3
Viewer • Updated • 24.3k • 18 -
RedaAlami/dataset0_3-dataset1_3-dataset2_3-dataset3_3
Viewer • Updated • 33.7k • 18 -
RedaAlami/dataset0_3-dataset1_3-dataset2_3-dataset3_3-dataset4_3
Viewer • Updated • 43.2k • 18 -
RedaAlami/PKU-SafeRLHF-Filtered-epsilon-0.5-Split-1-rho-1-phi-1
Viewer • Updated • 9.42k • 3 -
RedaAlami/PKU-SafeRLHF-Filtered-epsilon-0.5-Split-2-rho-1-phi-1
Viewer • Updated • 9.42k • 3 -
RedaAlami/PKU-SafeRLHF-Filtered-epsilon-0.5-Split-3-rho-1-phi-1
Viewer • Updated • 9.42k • 3 -
RedaAlami/PKU-SafeRLHF-Filtered-epsilon-0.5-Split-4-rho-1-phi-1
Viewer • Updated • 9.42k • 3 -
RedaAlami/PKU-SafeRLHF-Filtered-epsilon-0.5-Split-5-rho-1-phi-1
Viewer • Updated • 9.42k • 3 -
simonycl/gemma2-9B-it-ultrafeedback-single-judge
Viewer • Updated • 21.9k • 18 -
qgallouedec/hh-rlhf-helpful-base
Viewer • Updated • 46.2k • 2 -
HanxuHU/llama3.1-ultrafeedback-annotate-start-0-end-0.25-judge-5
Viewer • Updated • 5k • 3 -
RedaAlami/dataset0_3-dataset1_3-dataset2_3-dataset3_3-dataset4_3-dataset5_3
Viewer • Updated • 52.6k • 18 -
scottsuk0306/pairwise-preference-sample
Viewer • Updated • 3 • 5 -
scottsuk0306/alpaca_farm_gpt4-pairwise-preference
Viewer • Updated • 19.5k • 40 -
scottsuk0306/alpaca_farm_human-pairwise-preference
Viewer • Updated • 9.69k • 34 -
scottsuk0306/nectar-pairwise-preference
Viewer • Updated • 1.83M • 4 -
scottsuk0306/distilabel_math_dpo-pairwise-preference
Viewer • Updated • 2.42k • 22 -
scottsuk0306/chatbot_arena_2023-pairwise-preference
Viewer • Updated • 33k • 42 -
scottsuk0306/helpsteer2-pairwise-preference
Viewer • Updated • 10.7k • 21 -
scottsuk0306/summarize_from_feedback-pairwise-preference
Viewer • Updated • 91.9k • 13 -
scottsuk0306/webgpt-pairwise-preference
Viewer • Updated • 18.6k • 13 -
scottsuk0306/ultrafeedback-pairwise-preference
Viewer • Updated • 158k • 27 -
scottsuk0306/ultrainteract-pairwise-preference
Viewer • Updated • 220k • 20 -
nbalepur/defeasible-alignment-subset
Viewer • Updated • 26.9k • 137 -
HanxuHU/gemma-2-9b-it-ultrafeedback-annotate-start-0.5-end-1.0-judge-5
Viewer • Updated • 10k • 3 -
simonycl/Llama-3-8B-Instruct-ultrafeedback-armorm-annotate
Viewer • Updated • 62k • 21 -
simonycl/gemma2-9B-it-ultrafeedback-judge-5
Viewer • Updated • 21.9k • 18 -
simonycl/Llama-3-8B-Instruct-ultrafeedback-judge-5-annotate
Viewer • Updated • 62k • 10 -
simonycl/Meta-Llama-3-8B-Instruct_ultrafeedback-Meta-Llama-3-8B-Instruct-annotate-start-0-end-0.5-judge-5
Viewer • Updated • 30k • 2 -
HanxuHU/Meta-Llama-3-8B-Instruct_metamath-Meta-Llama-3-8B-Instruct-annotate-start-0-end-0.5-judge-5
Viewer • Updated • 32.5k • 3 -
HanxuHU/Meta-Llama-3-8B-Instruct_metamath-Meta-Llama-3-8B-Instruct-single-judge-0.5-1-judge
Viewer • Updated • 10k • 2 -
simonycl/Meta-Llama-3-8B-Instruct_ultrafeedback_single_judge_0_0.25_gen
Viewer • Updated • 15k • 2 -
simonycl/Meta-Llama-3-8B-Instruct_ultrafeedback_single_judge_0.25_0.5_gen
Viewer • Updated • 15k • 3 -
simonycl/Meta-Llama-3-8B-Instruct_ultrafeedback_single_judge_0.5_1_gen
Viewer • Updated • 30k • 3 -
simonycl/Meta-Llama-3-8B-Instruct_ultrafeedback_single_judge
Viewer • Updated • 62k • 8 -
simonycl/Meta-Llama-3-8B-Instruct-metamath-rm-annotate
Viewer • Updated • 67k • 28 -
simonycl/Meta-Llama-3-8B-Instruct_metamath_single_judge
Viewer • Updated • 67k • 26 -
valpy/rm_some_uf
Viewer • Updated • 101k • 25 -
simonycl/Meta-Llama-3.1-8B-Instruct_ultrafeedback_iter_0_rm_annotate
Viewer • Updated • 16.9k • 16 -
RedaAlami/dataset0_4-dataset1_4
Viewer • Updated • 10.1k • 16 -
RedaAlami/dataset0_4-dataset1_4-dataset2_4
Viewer • Updated • 14.8k • 17 -
RedaAlami/dataset0_4-dataset1_4-dataset2_4-dataset3_4
Viewer • Updated • 19.5k • 32 -
RedaAlami/dataset0_4-dataset1_4-dataset2_4-dataset3_4-dataset4_4
Viewer • Updated • 24.2k • 32 -
RedaAlami/PKU-SafeRLHF-Swept-epsilon-0.1-Split-1
Viewer • Updated • 9.42k • 3 -
RedaAlami/PKU-SafeRLHF-Swept-epsilon-0.1-Split-2
Viewer • Updated • 9.42k • 5 -
RedaAlami/PKU-SafeRLHF-Swept-epsilon-0.1-Split-3
Viewer • Updated • 9.42k • 5 -
RedaAlami/PKU-SafeRLHF-Swept-epsilon-0.1-Split-4
Viewer • Updated • 9.42k • 5 -
RedaAlami/PKU-SafeRLHF-Swept-epsilon-0.1-Split-5
Viewer • Updated • 9.42k • 5 -
simonycl/Meta-Llama-3-8B-Instruct_metamath_single_judge_0_0.5
Viewer • Updated • 32.5k • 3 -
simonycl/Meta-Llama-3-8B-Instruct_metamath_single_judge_0.5_1.0
Viewer • Updated • 32.5k • 2 -
RedaAlami/PKU-SafeRLHF-Filtered-epsilon-0.5-Split-1-rho-0.5-phi-0.5
Viewer • Updated • 4.62k • 2 -
RedaAlami/PKU-SafeRLHF-Filtered-epsilon-0.5-Split-2-rho-0.5-phi-0.5
Viewer • Updated • 4.65k • 3 -
RedaAlami/PKU-SafeRLHF-Filtered-epsilon-0.5-Split-3-rho-0.5-phi-0.5
Viewer • Updated • 4.72k • 2 -
RedaAlami/PKU-SafeRLHF-Filtered-epsilon-0.5-Split-4-rho-0.5-phi-0.5
Viewer • Updated • 4.67k • 3 -
RedaAlami/PKU-SafeRLHF-Filtered-epsilon-0.5-Split-5-rho-0.5-phi-0.5
Viewer • Updated • 4.73k • 3 -
RedaAlami/PKU-SafeRLHF-Filtered-epsilon-0.1-Split-1-rho-1-phi-1
Viewer • Updated • 9.42k • 3 -
RedaAlami/PKU-SafeRLHF-Filtered-epsilon-0.1-Split-2-rho-1-phi-1
Viewer • Updated • 9.42k • 2 -
RedaAlami/PKU-SafeRLHF-Filtered-epsilon-0.1-Split-3-rho-1-phi-1
Viewer • Updated • 9.42k • 1 -
RedaAlami/PKU-SafeRLHF-Filtered-epsilon-0.1-Split-4-rho-1-phi-1
Viewer • Updated • 9.42k • 1 -
RedaAlami/PKU-SafeRLHF-Filtered-epsilon-0.1-Split-5-rho-1-phi-1
Viewer • Updated • 9.42k • 2 -
simonycl/Meta-Llama-3-8B-Instruct_metamath-Meta-Llama-3-8B-Instruct-annotate-start-0.75-end-1.0-judge-5
Viewer • Updated • 16.2k • 2 -
simonycl/Meta-Llama-3-8B-Instruct_metamath-Meta-Llama-3-8B-Instruct-annotate-start-0.5-end-0.75-judge-5
Viewer • Updated • 16.2k • 3 -
RedaAlami/dataset0_4-dataset1_4-dataset2_4-dataset3_4-dataset4_4-dataset5_4
Viewer • Updated • 28.9k • 18 -
RedaAlami/dataset0_5-dataset1_5
Viewer • Updated • 14.9k • 32 -
RedaAlami/dataset0_5-dataset1_5-dataset2_5
Viewer • Updated • 24.3k • 33 -
RedaAlami/dataset0_5-dataset1_5-dataset2_5-dataset3_5
Viewer • Updated • 33.7k • 33 -
RedaAlami/dataset0_5-dataset1_5-dataset2_5-dataset3_5-dataset4_5
Viewer • Updated • 43.2k • 32 -
RedaAlami/dataset0_5-dataset1_5-dataset2_5-dataset3_5-dataset4_5-dataset5_5
Viewer • Updated • 52.6k • 16 -
ummagumm-a/ultrafeedback_binarized_all_pairs
Viewer • Updated • 929k • 7 -
qgallouedec/tldr-preference
Viewer • Updated • 179k • 7 -
qgallouedec/lm-human-preferences-sentiment
Viewer • Updated • 6.26k • 2 -
qgallouedec/lm-human-preferences-descriptiveness
Viewer • Updated • 6.26k • 2 -
allenai/reward-bench-cleaned-preview
Viewer • Updated • 2.9k • 6 -
simonycl/Meta-Llama-3-8B-Instruct_metamath-Meta-Llama-3-8B-Instruct-annotate-judge-5
Viewer • Updated • 67k • 10 -
simonycl/Meta-Llama-3.1-8B-Instruct_ultrafeedback_iter_1_rm_annotate
Viewer • Updated • 16.8k • 26 -
ucsahin/TR-VLM-DPO-Dataset
Viewer • Updated • 10k • 5 • 1 -
simonycl/Meta-Llama-3.1-8B-Instruct_ultrafeedback_iter_2_rm_annotate
Viewer • Updated • 16.8k • 10 -
yjwon/ub_custommix_mistral7b_dpo_onpolicy
Viewer • Updated • 60.9k • 2 -
yjwon/ub_mistral7b_dpo_onpolicy
Viewer • Updated • 60.8k • 19 -
HanxuHU/Meta-Llama-3-8B-Instruct_metamath-annotate-start-0-end-0.5-judge-5-mtbench-cot-truth
Viewer • Updated • 32.5k • 3 -
simonycl/Meta-Llama-3.1-8B-Instruct_ultrafeedback_iter_3_rm_annotate
Viewer • Updated • 16.8k • 10 -
simonycl/Meta-Llama-3-8B-Instruct_metamath-annotate-start-0.5-end-0.75-judge-5-mtbench_cot_truth
Viewer • Updated • 16.2k • 3 -
simonycl/Meta-Llama-3-8B-Instruct_metamath-annotate-start-0.75-end-1.0-judge-5-mtbench_cot_truth
Viewer • Updated • 16.2k • 3 -
simonycl/Meta-Llama-3-8B-Instruct_metamath-annotate-start-0.5-end-0.75-judge-5-mtbench_cot_reason
Viewer • Updated • 16.2k • 2 -
simonycl/Meta-Llama-3-8B-Instruct_metamath-annotate-start-0.75-end-1.0-judge-5-mtbench_cot_reason
Viewer • Updated • 16.2k • 2 -
simonycl/Meta-Llama-3-8B-Instruct_metamath-annotate-start-0.5-end-0.75-judge-5-mtbench_cot_safe
Viewer • Updated • 16.2k • 2 -
simonycl/Meta-Llama-3-8B-Instruct_metamath-annotate-start-0.75-end-1.0-judge-5-mtbench_cot_safe
Viewer • Updated • 16.2k • 2 -
simonycl/Meta-Llama-3-8B-Instruct_metamath-annotate-start-0.5-end-0.75-judge-5-mtbench_cot_chathard
Viewer • Updated • 16.2k • 2 -
simonycl/Meta-Llama-3-8B-Instruct_metamath-annotate-start-0.75-end-1.0-judge-5-mtbench_cot_chathard
Viewer • Updated • 16.2k • 2 -
simonycl/Meta-Llama-3-8B-Instruct_metamath-annotate-start-0.5-end-0.75-judge-5-mtbench_cot_hon
Viewer • Updated • 16.2k • 2 -
simonycl/Meta-Llama-3-8B-Instruct_metamath-annotate-start-0.75-end-1.0-judge-5-mtbench_cot_hon
Viewer • Updated • 16.2k • 2 -
yjwon/custommix_gemma9b_chat_dpo_beta5e-2_onpolicy
Viewer • Updated • 26.2k • 15 -
simonycl/Meta-Llama-3-8B-Instruct_ultrafeedback-annotate-start-0.5-end-0.75-judge-5-mtbench_cot_truth
Viewer • Updated • 15k • 3 -
simonycl/Meta-Llama-3-8B-Instruct_ultrafeedback-annotate-start-0.75-end-1.0-judge-5-mtbench_cot_truth
Viewer • Updated • 15k • 4 -
simonycl/Meta-Llama-3-8B-Instruct_ultrafeedback-annotate-start-0.5-end-0.75-judge-5-mtbench_cot_reason
Viewer • Updated • 15k • 2 -
simonycl/Meta-Llama-3-8B-Instruct_ultrafeedback-annotate-start-0.75-end-1.0-judge-5-mtbench_cot_reason
Viewer • Updated • 15k • 2 -
simonycl/Meta-Llama-3-8B-Instruct_ultrafeedback-annotate-start-0.5-end-0.75-judge-5-mtbench_cot_safe
Viewer • Updated • 15k • 2 -
simonycl/Meta-Llama-3-8B-Instruct_ultrafeedback-annotate-start-0.75-end-1.0-judge-5-mtbench_cot_safe
Viewer • Updated • 15k • 2 -
simonycl/Meta-Llama-3-8B-Instruct_ultrafeedback-annotate-start-0.5-end-0.75-judge-5-mtbench_cot_chathard
Viewer • Updated • 15k • 2 -
simonycl/Meta-Llama-3-8B-Instruct_ultrafeedback-annotate-mebench_cot_truth
Viewer • Updated • 62k • 10 -
simonycl/Meta-Llama-3-8B-Instruct_ultrafeedback-annotate-start-0.5-end-0.75-judge-5-mtbench_cot_hon
Viewer • Updated • 15k • 2 -
simonycl/Meta-Llama-3-8B-Instruct_ultrafeedback-annotate-start-0.75-end-1.0-judge-5-mtbench_cot_chathard
Viewer • Updated • 15k • 2 -
simonycl/Meta-Llama-3-8B-Instruct_metamath-annotate-judge-5-mtbench_cot_truth
Viewer • Updated • 67k • 10 -
simonycl/Meta-Llama-3-8B-Instruct_ultrafeedback-annotate-start-0.75-end-1.0-judge-5-mtbench_cot_hon
Viewer • Updated • 15k • 2 -
simonycl/gemma2-9B-it-ultrafeedback-gemma-2-9b-it-annotate-start-0-end-0.5-judge-5
Viewer • Updated • 29.4k • 2 -
trl-lib/tldr-preference
Viewer • Updated • 179k • 3 -
trl-lib/lm-human-preferences-descriptiveness
Viewer • Updated • 6.26k • 3 -
trl-lib/lm-human-preferences-sentiment
Viewer • Updated • 6.26k • 13 -
amphora/test-mrb-v01
Viewer • Updated • 63 • 2 -
amphora/test-mrb-v02
Viewer • Updated • 63 • 1 -
amphora/test-mrb-v03
Viewer • Updated • 42 • 4 -
amphora/test-mrb-v04
Viewer • Updated • 42 • 2 -
amphora/test-mrb-v05
Viewer • Updated • 63 • 4 -
amphora/test-mrb-v06
Viewer • Updated • 42 • 2 -
amphora/test-mrb-v07
Viewer • Updated • 42 • 5 -
amphora/test-mrb-v08
Viewer • Updated • 42 • 3 -
amphora/test-mrb-ko-v0
Viewer • Updated • 140 • 4 -
amphora/test-mrb-ko-v1
Viewer • Updated • 14 • 4 -
ohsuz/dpo-koen
Viewer • Updated • 54.5k • 8 -
alckasoc/smollm_dpo_examples_19k
Viewer • Updated • 19.8k • 1 -
RyanYr/reward-judge_reward-judge-trainset-gen_judgements-preference-filtered-gen_pilot-exp
Viewer • Updated • 50k • 28 -
yiran-wang3/original_cn_rl_oj_debug_iter0-binarized
Viewer • Updated • 2 -
yiran-wang3/original_cn_mining_sandbox_debug_iter0-binarized
Viewer • Updated • 2 -
self-generate/ds_chat_original_cn_rl_oj_debug_iter0-binarized
Viewer • Updated • 5 -
yjwon/custommix_gemma9b_ogd_onpolicy
Viewer • Updated • 26.3k -
self-generate/ds_chat_original_cn_mining_sandbox_debug_iter0-binarized
Viewer • Updated • 2 -
ChaiML/Virgo-Edit-v2-tl-ai_agree_with_user
Viewer • Updated • 1.5k -
ChaiML/Virgo-Edit-v2-tl-ai_disagree_with_user
Viewer • Updated • 1.5k -
ChaiML/Virgo-Edit-v2-tl-top_bot_personality
Viewer • Updated • 1.5k -
ChaiML/Virgo-Edit-v2-tl-top_model_strength
Viewer • Updated • 1.5k -
ChaiML/Virgo-Edit-v2-tl-bottom_model_strength
Viewer • Updated • 1.5k -
ChaiML/Virgo-Edit-v2-tl-top_model_weakness
Viewer • Updated • 1.5k -
ChaiML/Virgo-Edit-v2-tl-romance
Viewer • Updated • 1.5k -
ChaiML/Virgo-Edit-v2-tl-conflict
Viewer • Updated • 1.5k -
ChaiML/Virgo-Edit-v2-tl-random
Viewer • Updated • 1.5k -
sirsam01/codeit_gec
Viewer • Updated • 20.3k -
self-generate/ds_chat_original_cn_mining_oj_iter0-binarized
Viewer • Updated • 5.73k • 777 -
minhquy1624/rlhf_summarization
Viewer • Updated • 5k • 2 -
Dayyyan/test
Viewer • Updated • 1 -
self-generate/ds_chat_original_cn_mining_sandbox_iter0-binarized
Viewer • Updated • 7.75k • 726 -
self-generate/ds_chat_original_cn_rl_oj_iter0-binarized
Viewer • Updated • 4.75k • 732 -
SongTonyLi/merged_ultrafeedback_binarized_argilla_orca
Viewer • Updated • 74k • 34 -
SongTonyLi/merged_ultrafeedback_binarized_argilla_orca_skywork_preference
Viewer • Updated • 156k • 62 • 1 -
lewtun/ultrafeedback_binarized
Viewer • Updated • 62.1k • 17 -
self-generate/ds_chat_original_cn_mining_oj_iter0-full_response_traceback
Viewer • Updated • 5.73k • 1 -
coscotuff/SLFT_Trials
Viewer • Updated • 19.8k -
acforvs/dpo-edit-v1
Viewer • Updated • 19.7k -
self-generate/ds_chat_original_cn_rl_oj_iter0-full_response_traceback
Viewer • Updated • 4.75k -
self-generate/ds_chat_original_cn_mining_sandbox_iter0-full_response_traceback
Viewer • Updated • 7.75k -
NobleMathews/GrammarSFT-DPO
Viewer • Updated • 19.9k -
prasanthyss/dpo_train_ds_focused_1
Viewer • Updated • 14.7k -
prasanthyss/dpo_test_ds_focused_1
Viewer • Updated • 455 -
Avinaash/dpo_edit_distance_test
Viewer • Updated • 7.71k • 53 -
Avinaash/CleanDPODataset
Viewer • Updated • 11.2k • 6 -
sarthakrw/smollm-dpo-preference-dataset
Viewer • Updated • 20.2k -
ravithejads/test_dataset_dpo
Viewer • Updated • 375 -
ammarnasr/SmolLM-135M-GEC-preference-dataset
Viewer • Updated • 19.8k • 5 -
SongTonyLi/merged_orca_skywork_capybara_preference
Viewer • Updated • 110k • 30 -
SongTonyLi/merged_orca_skywork_preference
Viewer • Updated • 94.8k • 24 -
SongTonyLi/merged_orca_skywork_capybara_infinity_mid_preference
Viewer • Updated • 71.5k • 53 -
SongTonyLi/merged_orca_skywork_capybara_infinity_small_preference
Viewer • Updated • 40.9k • 8 -
RyanYr/reward-judge_sft-genRM_inf-scaling-law_pilot-exp_rewards
Viewer • Updated • 456 • 6 -
RyanYr/reward-judge_iterBoN2-genRM_inf-scaling-law_pilot-exp_rewards
Viewer • Updated • 456 • 2 -
alckasoc/smollm_dpo_examples_19k_1
Viewer • Updated • 19.8k • 1 -
alckasoc/smollm_dpo_examples_19k_2
Viewer • Updated • 19.8k • 1 -
alckasoc/smollm_dpo_examples_19k_3
Viewer • Updated • 19.8k -
ravithejads/test_cpo_bleu
Viewer • Updated • 374 -
RyanYr/reward-bench_filtered_chat-hard
Viewer • Updated • 456 -
SongTonyLi/capybara_preference
Viewer • Updated • 14.8k -
AugustasM/C4AI-preference-dataset-original
Viewer • Updated • 19.8k -
AugustasM/C4AI-preference-dataset-cleaned
Viewer • Updated • 19.8k -
not-lain/gec-preference-data
Viewer • Updated • 200 -
kenza-ily/c4ai-csp-kb-dpo-dataset-train_mini
Viewer • Updated • 19 -
kenza-ily/c4ai-csp-kb-dpo-dataset-val_mini
Viewer • Updated • 24 -
RyanYr/reward-judge_sft-genRM_inf-scaling-law_pilot-exp
Viewer • Updated • 4 -
alisa-yingjia-wan/gec_SmolLM_DPO
Viewer • Updated • 25.6k -
blesspearl/grammar_dpo
Viewer • Updated • 19.8k -
coscotuff/SLFT_Trials_ORPO
Viewer • Updated • 19.8k -
RedaAlami/PKU-SafeRLHF_ultrafeedback
Viewer • Updated • 110k -
kenza-ily/c4ai_csp-dop_preference
Viewer • Updated • 6.61k -
baconnier/reflection_dataset
Viewer • Updated • 60.9k -
nlee-208/Qwen2-7B-Instruct-Self-teacher-w-armo
Viewer • Updated • 60.9k • 1 -
meaningalignment/wise-data
Viewer • Updated • 3.41k -
ai2-adapt-dev/math_numina_balanced_none_mc_prefs_minerva_format
Viewer • Updated • 41.6k • 89 -
SongTonyLi/dpo-mix-shuffled
Viewer • Updated • 44.2k • 89 -
SongTonyLi/dpo-mix_skywork_infinity
Viewer • Updated • 131k • 7 • 1 -
ai2-adapt-dev/numina_math_gsm8k_prefs_balance_minerva_format_v2
Viewer • Updated • 22.8k • 3 -
Abduulllaah/orca_dpo_pairs-2k
Viewer • Updated • 2k -
prasanthyss/dpop_submitted_train
Viewer • Updated • 19.8k -
prasanthyss/dpop_submitted_test
Viewer • Updated • 485 -
Windy/llama3base_bsln_sppo_t0_10k
Viewer • Updated • 10k -
Windy/mistralbase_bsln_sppo_t0_10k
Viewer • Updated • 10k -
Windy/mistralbase_bsln_sppo_t1_10k
Viewer • Updated • 10k -
Windy/llama3base_bsln_sppo_t1_10k
Viewer • Updated • 10k -
Windy/llama3base_bsln_sppo_t2_10k
Viewer • Updated • 10k -
Windy/mistralbase_bsln_sppo_t2_10k
Viewer • Updated • 10k -
RyanYr/reward-judge_sft_t0.5-genRM_inf-scaling-law_pilot-exp_rewards
Viewer • Updated • 456 • 1 -
simonycl/helpsteer2_preference_data
Viewer • Updated • 413 • 22 -
nbalepur/personas
Viewer • Updated • 37.8k • 7 -
yiran-wang3/None-binarized
Viewer • Updated -
yiran-wang3/None-full_response_traceback
Viewer • Updated -
self-generate/cl_python_original_cn_mining_oj_iter0-binarized
Viewer • Updated • 3 -
self-generate/cl_python_original_cn_mining_oj_iter0-full_response_traceback
Viewer • Updated • 3 -
amphora/reasoning-rm-test
Viewer • Updated • 199 -
pbevan11/ultrafeedback_binarized_multilingual
Viewer • Updated • 80k