1-shot
75.2
25.3
21.8
80.7
82.0
85.6
84.6
77.9
87.5
75.7
53.3
68.9
82.2
59.6
85.6
57.4
88.1
89.0
78.7
50.6
84.0
92.1
82.1
53.1
48.8
53.2
69.9

1-shot
81.7
32.0
26.9
83.7
84.0
86.7
88.1
79.2
90.5
77.1
57.2
71.9
83.2
64.9
88.0
56.2
88.6
90.0
81.9
52.0
84.1
92.4
80.4
58.1
49.5
54.5
72.0

1-shot
86.1
37.5
28.2
86.9
86.8
87.4
86.9
83.0
89.5
80.5
62.3
77.0
85.0
69.2
89.7
58.5
90.9
96.0
79.3
66.8
88.2
93.8
87.5
73.1
63.4
67.1
76.9

11

Table 3: F1 scores on the multilingual TyDi QA datasets in a 1-shot setting. We evaluate in the Gold Passage and a
novel no-context setting.

Gold Passage

PaLM 2-M PaLM 2-L

No-context

PaLM 2-M PaLM 2-L

Language
Arabic
Bengali
English
Finnish
Indonesian
Korean
Russian
Swahili
Telugu
Average

PaLM PaLM 2-S
67.2
74.0
69.3
68.1
75.7
70.6
57.6
77.3
68.0
69.8

73.8
75.4
73.4
71.9
79.5
71.4
59.1
79.7
75.7
73.3

73.5
72.9
73.4
71.7
80.2
72.3
58.6
81.8
75.5
73.3

PaLM PaLM 2-S
34.5
27.6
38.3
38.3
35.5
35.0
24.6
39.7
9.6
31.5
PaLM 2 Technical Report