calls. We use this new dataset to ﬁnetune M, using
a standard language modeling objective. Crucially,
apart from inserted API calls the augmented dataset
C∗ contains the exact same texts as C, the original
dataset. As a consequence, ﬁnetuning M on C∗
exposes it to the same content as ﬁnetuning on C.
Moreover, as API calls are inserted in exactly those
positions and with exactly those inputs that help
M predict future tokens, ﬁnetuning on C∗ enables
the language model to decide when and how to use
which tool, based purely on its own feedback.
Toolformer