18.5
18.4
18.9
26.3
18.6
29.0

12.8
12.2
12.6
17.7
11.4
22.6

43.9
45.6
46.7
48.8
45.7
65.9

Table 5: Results for various question answering dataset.
Using the Wikipedia search tool for most examples,
Toolformer clearly outperforms baselines of the same
size, but falls short of GPT-3 (175B).

this would make solving the tasks trivial, especially
given that the underlying QA system was ﬁnetuned
on Natural Questions.
Toolformer