diverse than XXXP3 as shown in Figure 3b. It appears

the human-written text as XXX{·} or YYY {·}, except for YYY P3 and
YYY FLAN that are also generated by gpt-3.5-turbo.

4Model signature: all-mpnet-base-v2.

s
e
l
p
m
a
s

f
o

#

20

10

0

s
e
l
p
m
a
s

f
o

#

20

10

0

1

1

3

2

19

20

19

17

18

20

20

(cid:98)XXX

(cid:98)XXX

(cid:98)XXX

(cid:98)XXX

(cid:98)XXX

S
I

t,S
I

P

3

F

L

A

N

XXX

XXX

A

P

3

F

L

A

N

Rate-A Rate-B Rate-C Rate-D

(a) Human evaluation for the instruction (XXX{·} or (cid:98)XXX{·}).

2

3

2

2

20

18

17

18

18

1
2
2

15

1

19

(cid:98)YYY

(cid:98)YYY

(cid:98)YYY

(cid:98)YYY

(cid:98)YYY

S
I

t,S
I

P

3

F

L

A

N

YYY

YYY

A

P

3

F

L

A

N

Rate-A Rate-B Rate-C Rate-D

(b) Human evaluation for the responses (YYY {·} or (cid:98)YYY {·}).

Figure 4: Human evaluation results for the generated
instruction dataset.

• Rate-D: The generated text is completely un-

rors in content.

acceptable.
LaMini-LM- A Diverse Herd of Distilled Models from Large-Scale Instructions