SwitchCIT: Switching for Continual Instruction Tuning of Large Language Models
<|reference_start|>SwitchCIT: Switching for Continual Instruction Tuning of Large Language Models: Large language models (LLMs) have exhibited impressive capabilities in various domains, particularly in general language understanding. However these models, trained on massive text data, may not be finely optimized for specific tasks triggered by instructions. Continual instruction tuning is crucial to adapt LLMs to evolving tasks and domains, ensuring their effectiveness and relevance across a wide range of applications. In the context of continual instruction tuning, where models are sequentially trained on different tasks, catastrophic forgetting can occur, leading to performance degradation on previously learned tasks. This work addresses the catastrophic forgetting in continual instruction learning for LLMs through a switching mechanism for routing computations to parameter-efficient tuned models. We demonstrate the effectiveness of our method through experiments on continual instruction tuning of different natural language generation tasks.<|reference_end|>
@article{wu2024switchcit:,
    title={SwitchCIT: Switching for Continual Instruction Tuning of Large Language
  Models},
    author={Xinbo Wu, Max Hartman, Vidhata Arjun Jayaraman, Lav R. Varshney},
    journal={arXiv preprint arXiv:2407.11780},
    year={2024},
    archivePrefix={arXiv},
    eprint={2407.11780},
    primaryClass={cs.CL cs.AI}
}