the intent and available tools, and then develop a plan to select the appropriate tools for tackling tasks, which
will be discussed in § 3.2.1. In cases where the query is complex and targets a high-level task, C may need to
decompose the task into multiple sub-tasks, which requires foundational models to have powerful planning
and reasoning capabilities (§ 3.2.2).
Perceiver. The perceiver P is responsible for processing the user’s and the environment’s feedback and
generating a summary for the controller. Simple forms of feedback processing include concatenating the user
and environment feedback or formatting the feedback using a pre-deﬁned template. The summarized feedback
is then passed to the controller to assist its decision-making. By observing this feedback, the controller
can determine whether the generated plan is effective and whether there are anomalies during the execution
Tool Learning with Foundation Models