8

(a) Physical Interaction-based ToolsObservationPhysical  ToolsAgentReal worldObservationUserToolsObservationProgramming InterfaceDeveloperGraphical User Interface (GUI)(b) GUI-based Tools(c) Program-based ToolsDatabaseKnowledge GraphSoftwares/SDKPhysical world to  virtual worldVisual operation to programming operationWebPhotoshop2.4 Complementary Roles of Specialized Tools and Foundation Models
Tool Learning with Foundation Models