5 Related Work

Instruction tuning for LLMs. Our work shares the same goal as the broad category of efforts on
finetuning large language models to follow instructions. Early work on instruction tuning mainly
focused on NLP tasks, with the finding that finetuning with NLP datasets formatted as instruction-
output pairs improves cross-task generalization Wei et al. [2021], Mishra et al. [2021], Sanh et al.
[2021], Wang et al. [2022b]. Recent work Ouyang et al. [2022] extends instruction tuning to a broader
range of general tasks, especially incorporating instructions from users of language models.
Self-AlignmentwithInstructionBacktranslation