FLAN


## Finetuned Language Models are Zero-Shot Learners
Instruction 데이터셋을 통해 fine-tuning을 진행하고 이를 통해 zero-shot 성능을 높이는 방법
Mismatch between LM objective and human preferences 문제가 있는데 [RLHF](https://texonom.com/rlhf-4b184f9c9e8b4c7a8861fb6374e91aa6) 에서 개선
[Zero shot learning](https://texonom.com/zero-shot-learning-8c92d9386f6648f5b877cb593ec2747b)




> [Introducing FLAN: More generalizable Language Models with Instruction Fine-Tuning](https://ai.googleblog.com/2021/10/introducing-flan-more-generalizable.html?m=1)

> [Instruction Tuning이란?](https://velog.io/@nellcome/Instruction-Tuning이란)

> [Finetuned Language Models Are Zero-Shot Learners](https://arxiv.org/abs/2109.01652)





