Instruction Tuning


### teach language models to follow instructions to solve a task
fine-tune less powerful LLMs by using the output of a teacher LLM as a training target for supervised fine-tuning of another LLM
instruction으로 설명된 NLP 작업 모음을 사용
> 산업적으로 데이터셋 누구나 쉽게 만들 수 있다는 게 핵심적 의미
### Instruction Tuning Notion
|Title|
|:-:|
|[FLAN](https://texonom.com/flan-1a75823bb4b645e690ee6c20fcafb2c9)|
|[Self Instruct Tuning](https://texonom.com/self-instruct-tuning-061b12de01344308823ec115c5a17cc2)|
|[Evol Instruct Tuning](https://texonom.com/evol-instruct-tuning-3f73fb4abf574b1d87b9952e39d67196)|
|[Open Instruct](https://texonom.com/open-instruct-bbb16a58ec6445498a145c4ca37c2e5a)|



> [Imitation Models and the Open-Source LLM Revolution](https://cameronrwolfe.substack.com/p/imitation-models-and-the-open-source)






