Unleashing the Power of Data Tsunami: A Comprehensive Survey on Data
  Assessment and Selection for Instruction Tuning of Language Models
Instruction tuning plays a critical role in aligning large language models
(LLMs) with human preference. Despite the vast amount of open instruction
datasets, naively training a LLM on all existing instructions may not be
optimal and practical. To pinpoint the most beneficial datapoints, data
assessment and selection methods have been proposed in the fields of natural
language processing (NLP) and deep learning. However, under the context of
instruction tuning, there still exists a gap in knowledge on what kind of data
evaluation metrics can be employed and how they can be integrated into the
selection mechanism. To bridge this gap, we present a comprehensive review on
existing literature of data assessment and selection especially for instruction
tuning of LLMs. We systematically categorize all applicable methods into
quality-based, diversity-based, and importance-based ones where a unified,
fine-grained taxonomy is structured. For each category, representative methods
are elaborated to describe the landscape of relevant research. In addition,
comparison between latest methods is conducted on their officially reported
results to provide in-depth discussions on their limitations. Finally, we
summarize the open challenges and propose the promosing avenues for future
studies. All related contents are available at
https://github.com/yuleiqin/fantastic-data-engineering.
66b1a447a90022f3af0d99e1
Yulei Qin
extracted_confirmed
2024-08-06T04:23:50.945Z
6390525c00fb8ec4a424e0ff
/avatars/4302571e2ef4a9875491221aa630a329.svg
Yulei Qin
user
yolay
66b1a447a90022f3af0d99e2
Yuncheng Yang
66b1a447a90022f3af0d99e3
Pengcheng Guo
admin_assigned
2024-08-06T10:17:07.851Z
6177f7212a5804028ecc498a
/avatars/a2a8b88b818d5b9e6869c52a970f9a62.svg
Pengcheng Guo
user
pcguo
66b1a447a90022f3af0d99e4
Gang Li
claimed_verified
2024-08-06T07:43:52.944Z
648c17fc17c7ceb9b4200d31
/avatars/abc5b025dd682935056c33a9e1e362f0.svg
Gang Li
user
ligang-cs
66b1a447a90022f3af0d99e5
Hang Shao
admin_assigned
2024-08-06T10:17:19.436Z
62ab2cd5aff249e2ab899113
/avatars/b2a1c203784ec08b1c5087cd21e4fc59.svg
shaohang
user
shaohang
66b1a447a90022f3af0d99e6
Yuchen Shi
66b1a447a90022f3af0d99e7
Zihan Xu
66b1a447a90022f3af0d99e8
Yun Gu
66b1a447a90022f3af0d99e9
Ke Li
claimed_verified
2025-01-09T10:11:46.065Z
63280915eeee4dd858083092
/avatars/78347af4af42527d53e88d9969c5c934.svg
Ke Li
user
tristanli
66b1a447a90022f3af0d99ea
Xing Sun
admin_assigned
2024-08-06T10:18:23.955Z
647401e50da364bd0d002f2a
/avatars/f1586f610f21ddb4f868856208c2cfab.svg
XING SUN
user
tedsun
Unleashing the Power of Data Tsunami: A Comprehensive Survey on Data
  Assessment and Selection for Instruction Tuning of Language Models
Instruction tuning plays a critical role in aligning large language models
(LLMs) with human preference. Despite the vast amount of open instruction
datasets, naively training a LLM on all existing instructions may not be
optimal and practical. To pinpoint the most beneficial datapoints, data
assessment and selection methods have been proposed in the fields of natural
language processing (NLP) and deep learning. However, under the context of
instruction tuning, there still exists a gap in knowledge on what kind of data
evaluation metrics can be employed and how they can be integrated into the
selection mechanism. To bridge this gap, we present a comprehensive review on
existing literature of data assessment and selection especially for instruction
tuning of LLMs. We systematically categorize all applicable methods into
quality-based, diversity-based, and importance-based ones where a unified,
fine-grained taxonomy is structured. For each category, representative methods
are elaborated to describe the landscape of relevant research. In addition,
comparison between latest methods is conducted on their officially reported
results to provide in-depth discussions on their limitations. Finally, we
summarize the open challenges and propose the promosing avenues for future
studies. All related contents are available at
https://github.com/yuleiqin/fantastic-data-engineering.
A review of existing data assessment and selection methods for instruction tuning of large language models categorizes them into quality-based, diversity-based, and importance-based approaches, discusses their limitations, and outlines future research directions.
large language models instruction tuning data assessment data selection quality-based diversity-based importance-based taxonomy fine-grained