75.2% on ﬁve-shot MMLU. We also publicly release Flan-T5 checkpoints,1 which achieve strong few-shot
performance even compared to much larger models, such as PaLM 62B. Overall, instruction ﬁnetuning is a
general method for improving the performance and usability of pretrained language models.
Scaling Instruction-Finetuned Language Models