the parse tree as well as its ﬁrst direct noun object.
26,559 out of the 52,445 instructions contain such
structure; other instructions usually contain more
complex clauses (e.g., “Classify whether this tweet
contains political content or not.”) or are framed
as questions (e.g., “Which of these statements are
true?”). We plot the top 20 most common root
verbs and their top 4 direct noun objects in Figure 2,
which accounts for 14% of the entire set. Overall,
we see quite diverse intents and textual formats in
these instructions.
We further study how the generated instructions
diﬀer from the seed instructions that are used to
prompt the generation. For each generated instruc-
tion, we compute its highest ROUGE-L overlap
with the 175 seed instructions. We plot the dis-
tribution of these ROUGE-L scores in Figure 3,
indicating a decent number of new instructions that
do not have much overlap with the seeds. We also
demonstrate diversity in length of the instructions,
SELF-INSTRUCT- Aligning Language Model with Self Generated Instructions