execution of programs is ofﬂoaded to Python interpreters. This method exhibits superior performance in
mathematical and symbolic reasoning tasks. Wang et al. (2022a) further show that incorporating symbolic
modules (e.g., arithmetic and navigation) into the action space could enhance an agent’s performance in inter-
active ﬁction games. Nye et al. (2021) augment PLMs with a scratchpad, allowing them to emit intermediate
Tool Learning with Foundation Models