Data Quality (§3.2)

Instruction Quality

Instruction Diversity

INSTRUCTEVAL (Chia et al., 2023), LIMA (Zhou et al., 2023a),
Ding et al. (2023), Wang et al. (2023d), Li et al. (2023a),
Instruction Mining (Cao et al., 2023)

UltraChat (Ding et al., 2023), LIMA (Zhou et al., 2023a),
Alpaca (Taori et al., 2023), #InsTag (Lu et al., 2023),
Explore-Instruct (Wan et al., 2023)

Instruction Complexity

#InsTag (Lu et al., 2023), WizardLM (Xu et al., 2023),
WizardCoder (Luo et al., 2023), Orca (Mukherjee et al., 2023),
Tree-Instruct (Zhao et al., 2023a), CELLO (He et al., 2023)

Prompt Design

Mishra et al. (2022), Khashabi et al. (2022), Gonen et al. (2022),
Yin et al. (2023b), Kung and Peng (2023), UIT (Liang et al., 2023),
Weber et al. (2023), Gudibande et al. (2023), Song et al. (2023)

Task Composition (§3.3)
DataManagementForLargeLanguageModels-ASurvey