are ﬁrst recited by sampling from a PLM and then used to generate the ﬁnal answer. The intuition is that
foundation models can also be seen as knowledge sources (i.e., model knowledge). Beyond the textual domain,
retrieval-augmented tool learning has also been investigated in vision foundation models. By accessing external
multi-modal knowledge sources, text-to-image models can generate more realistic and faithful images (Chen
et al., 2022a; Sheynin et al., 2022; Blattmann et al., 2022).
Tool Learning with Foundation Models