11

and observe that the instructions generated by our method are more evenly dispersed, while those
of ShareGPT and Alpaca are more clustered. This indicates that our method produces more diverse
instructions in terms of topics, while ShareGPT and Alpaca generate more similar instructions with
common themes.

Figure 9: The cluster scatter plot between ShareGPT, Alpaca, and ours four rounds of instruction
evolution from C1 to C4. The number of cluster centers is 20.

4.6 Case study
WizardLM- Empowering Large Language Models to Follow Complex Instructions