PaLM PaLM 2-S
11.18
11.97
13.94
10.15
11.59
11.49
14.43
9.01
14.82
15.7
14.52
13.87
12.51
16.43
5.59
7.54
15.16
14.57
12.47

15.11
15.66
19.62
14.40
20.87
15.17
19.59
19.51
15.2
19.5
21.8
17.6
15.6
23.0
14.6
17.0
18.1
16.91
17.74

a
u
g
n
i
l
i
k
i
W

m
u
S
-
L
X

Arabic
Japanese
Korean
Russian
Thai
Turkish
Arabic
Bengali
English
Indonesian
Japanese
Korean
Russian
Swahili
Telugu
Thai
Turkish
XSum–English
Average

91.7%
89.3%
94.7%
88.6%
95.1%
86.6%
73.8%
66.3%
48.6%
63.1%
25.0%
40.9%
69.3%
17.1%
92.5%
37.1%
50.7%
58.0%
66.0%

22.2
21.3
24.7
20.3
29.6
23.1
25.4
15.9
23.0
22.7
29.0
22.0
18.4
27.5
6.9
18.9
23.2
23.2
22.1

45

17.0
16.4
19.5
15.0
21.8
15.8
21.5
18.4
16.8
19.9
24.8
19.2
16.1
23.6
13.5
17.3
19.4
17.2
18.51

22.4
21.7
24.7
20.5
30.0
23.9
26.3
15.6
22.9
24.1
28.2
23.9
19.4
27.9
6.9
20.6
23.9
23.8
22.6

22.23
21.27
24.69
20.25
29.64
23.05
25.42
15.87
23.03
22.71
28.97
21.97
18.4
27.45
6.86
18.94
23.16
23.23
22.06
PaLM 2 Technical Report