Awesome SFT datasets - a HuggingFaceH4 Collection

HuggingFaceH4 's Collections

Zephyr 7B Gemma

Papers We've Read

Awesome SFT datasets

Awesome feedback datasets

Awesome reward models

Awesome SFT datasets

updated Apr 12

A curated list of interesting datasets to fine-tune language models with.

bjoernp/ultrachat_de

Viewer • Updated Dec 2, 2023 • 959 • 59 • 7
openchat/openchat_sharegpt4_dataset

Updated Jul 1, 2023 • 248 • 165

Note One of the datasets behind OpenChat-3.5
imone/OpenOrca_FLAN

Viewer • Updated Dec 8, 2023 • 1.58M • 118 • 15

Note One of the datasets behind OpenChat-3.5
tiedong/goat

Viewer • Updated May 25, 2023 • 1.75M • 71 • 34

Note One of the datasets behind OpenChat-3.5, focused on arithmetic
LDJnr/LessWrong-Amplify-Instruct

Viewer • Updated Jun 3 • 663 • 68 • 44

Note One of the datasets behind OpenChat-3.5
LDJnr/Pure-Dove

Viewer • Updated Jun 3 • 3.86k • 112 • 73

Note One of the datasets behind OpenChat-3.5. Possible leakage with MT-Bench prompts
glaiveai/glaive-code-assistant

Viewer • Updated Sep 27, 2023 • 136k • 145 • 86
meta-math/MetaMathQA

Viewer • Updated Dec 21, 2023 • 395k • 4.69k • 325
OpenAssistant/oasst_top1_2023-08-25

Viewer • Updated Aug 28, 2023 • 13.6k • 212 • 61

Note One of the datasets behind OpenChat-3.5
TIGER-Lab/MathInstruct

Viewer • Updated May 15 • 262k • 1.49k • 247
ise-uiuc/Magicoder-Evol-Instruct-110K

Viewer • Updated Dec 28, 2023 • 111k • 624 • 149
ise-uiuc/Magicoder-OSS-Instruct-75K

Viewer • Updated Dec 4, 2023 • 75.2k • 831 • 139
GAIR/lima

Viewer • Updated Jun 8, 2023 • 1.33k • 1.15k • 411
allenai/tulu-v2-sft-mixture

Viewer • Updated May 24 • 326k • 1.42k • 116

Note Some subsets are NC
glaiveai/glaive-function-calling-v2

Viewer • Updated Sep 27, 2023 • 113k • 567 • 385
glaiveai/glaive-code-assistant-v2

Viewer • Updated Apr 4 • 215k • 77 • 43
openai/gsm8k

Viewer • Updated Jan 4 • 17.6k • 200k • 409
jondurbin/airoboros-3.1

Viewer • Updated Dec 26, 2023 • 59.3k • 68 • 53
teknium/OpenHermes-2.5

Viewer • Updated Apr 15 • 1M • 5.62k • 680
Open-Orca/SlimOrca

Viewer • Updated Oct 12, 2023 • 518k • 571 • 269
lmsys/lmsys-chat-1m

Viewer • Updated Jul 27 • 1M • 70.3k • 592
garage-bAInd/Open-Platypus

Viewer • Updated Jan 24 • 24.9k • 2.66k • 370
LDJnr/Puffin

Viewer • Updated Jun 7 • 3k • 279 • 91
nampdn-ai/tiny-codes

Viewer • Updated Sep 30, 2023 • 1.63M • 362 • 226
shahules786/orca-chat

Viewer • Updated Jul 25, 2023 • 198k • 160 • 110
lmsys/chatbot_arena_conversations

Viewer • Updated Sep 30, 2023 • 33k • 567 • 337
cognitivecomputations/dolphin

Viewer • Updated Dec 18, 2023 • 3.73M • 380 • 399
pankajmathur/WizardLM_Orca

Viewer • Updated Jun 26, 2023 • 55k • 51 • 70
nomic-ai/gpt4all-j-prompt-generations

Viewer • Updated Apr 24, 2023 • 809k • 233 • 214
codeparrot/apps

Viewer • Updated Oct 20, 2022 • 20k • 1.99k • 121
allenai/WildChat

Viewer • Updated 23 days ago • 529k • 1.28k • 119
allenai/WildChat-nontoxic

Viewer • Updated May 6 • 530k • 184 • 23
LDJnr/Capybara

Viewer • Updated Jun 7 • 16k • 338 • 225
OpenAssistant/oasst2

Viewer • Updated Jan 11 • 135k • 1.29k • 211

Note The final version of the OpenAssistant dataset, consisting of 130k messages.
SebastianBodza/LeetCode_UserSubmissions

Viewer • Updated Jan 3 • 138k • 27 • 10
nuprl/CanItEdit

Viewer • Updated Mar 19 • 105 • 162 • 11
totally-not-an-llm/EverythingLM-data-V3

Viewer • Updated Sep 11, 2023 • 1.07k • 60 • 31
OpenMathInstruct-1: A 1.8 Million Math Instruction Tuning Dataset

Paper • 2402.10176 • Published Feb 15 • 34
microsoft/orca-math-word-problems-200k

Viewer • Updated Mar 4 • 200k • 1.78k • 414
qintongli/GSM-Plus-v0

Viewer • Updated Mar 4 • 10.6k • 50 • 6
Vezora/Tested-143k-Python-Alpaca

Viewer • Updated Mar 23 • 143k • 207 • 31