Cerebras-GPT Among all

LaMini-Flan-T5-783M
LaMini-T5-738M
Alpaca-7B
LaMini-Flan-T5-248M
LaMini-T5-223M
LaMini-GPT-1.5B
LaMini-Flan-T5-77M
LaMini-C.-1.3B
LaMini-GPT-774M
LaMini-T5-61M
LaMini-C.-590M
LaMini-C.-256M
Flan-T5-large-783M
LaMini-GPT-124M
LaMini-C.-111M
LLaMa-7B
Cerebras-GPT-1.3B
T5-large-738M
GPT-2-xl-1.5B

45
44

39

34

30
29
29

21
20
19
19

12
9
9

10
19

14

17

19

29

5
3
1
1
5

0

10
12

19

10

20
25

22
20

29
34

28

18

42

41

44

34

30

30
29

35

26

34

25
28

34

38

45
39

41

41

14
12
12

16

24
23

29
28
30
32
34

50

45
47

58

82

80

100

95

20

30

40

50

60

70

80

90

100

110

# of examples

Rate-A

Rate-B

Rate-C

Rate-D

Figure 6: Human evaluation results of the selected models on our 114 user-oriented instructions.

774M is outperforms LaMini-Cerebras-1.3B de-
spite being half in size. We also observe similar
results on human evaluation.
LaMini-LM- A Diverse Herd of Distilled Models from Large-Scale Instructions