Humanities
Humanities
Other
Social Science
Humanities
Humanities
Humanities

Social Science

Gopher
280B
25.0
56.3
65.8
70.0
67.2
70.8
45.0
49.0
37.0
60.1
34.3
65.0
49.4
43.0
60.0
33.6
35.7
38.0
71.3
47.8
54.0
72.1
76.8
83.9
65.1
23.7
66.4
33.8
81.8
50.0
78.9
75.1
66.4
67.2
77.7
71.3
72.4
41.1
77.7
83.3
69.0
75.7
66.8
40.2
69.9
68.8
67.6
44.3
44.5
64.0
68.1
71.8
64.9
84.1
81.0
47.0
84.2
56.2
47.4
71.9
66.1
60.0

Chinchilla

LLaMA

LLaMA-I

70B
31.0
70.4
73.0
72.0
75.1
79.9
51.0
51.0
32.0
66.5
46.1
76.0
67.2
38.6
62.1
41.5
33.3
39.0
80.3
58.1
58.0
78.8
86.4
91.2
70.5
31.9
77.7
36.4
86.6
58.8
83.3
85.2
77.6
86.3
90.9
79.6
80.4
41.1
82.5
89.7
69.0
84.5
77.5
36.5
77.1
79.4
81.2
52.1
56.5
75.4
75.7
73.6
75.9
91.0
92.0
53.6
87.7
63.6
54.9
79.3
73.9
67.6
LLaMA- Open and Efficient Foundation Language Models