65B
31.0
62.2
81.6
72.0
69.1
81.9
45.0
51.0
36.0
63.0
46.1
79.0
66.4
52.6
60.7
42.9
47.6
40.0
82.9
44.8
73.0
86.1
87.9
92.8
69.2
37.0
78.6
41.7
87.9
59.3
90.7
89.0
72.2
87.0
87.6
85.2
80.4
52.7
83.5
92.7
68.0
84.3
76.9
55.9
74.5
79.1
79.0
56.0
54.4
70.6
71.4
74.6
77.6
88.1
87.0
57.8
84.2
67.4
56.6
79.2
72.6
68.9

Table 16: MMLU. Detailed 5-shot results per domain on the test sets.

C Generations from LLaMA-65B

In this section, we show some examples of generations obtained with LLaMA-65B (without instruction
ﬁnetuning). Prompts are in bold.

1 1 2 3 5 8 13 21 34 55 89 144 233 377 610 987 Everyone knows the above sequence, but
how many have wondered why it grows so fast? It seems to be the fastest growing sequence
in mathematics.
LLaMA- Open and Efficient Foundation Language Models