tools. As the name suggests, this class of tools involves direct interactions with the physical world, including
devices like robots, sensors, and wearables that could physically impact the environment. Physical interaction
tools have the capability to sense and respond to the physical environment of users, making them useful in a
wide range of applications, from manufacturing to healthcare and education. Physical interaction tools are
close to the real world, and they have the potential to substantially improve efﬁciency and productivity. For
example, robots can perform from simple to intricate, even adventurous tasks to reduce human errors and labor
costs. Sensors can collect valuable data, such as temperature and pressure, allowing for real-time monitoring
and optimization of industrial processes. Wearables, on the other hand, provide users with a personalized
experience by tracking physiological or environmental parameters, promoting health and safety. It is worth
Tool Learning with Foundation Models