number. We manually curated 100 questions for evaluation.
To facilitate future research attempts, we implement and integrate all the above tools into BMTools21, which
is an open-source repository that extends foundation models using tools and also serves as a platform for the
community to build and share tools. With BMTools, users can easily build a new plugin by writing Python
functions and also integrating external tools from other sources (e.g., ChatGPT Plugins).
Building a tool library for foundation models is critical to connecting foundation models with tools and we
are glad to see there are emerging works in this direction. LangChain 22 is the ﬁrst open-sourced project
that attempts to chain foundation models with tools. Under a uniﬁed interface, users could either build their
own task pipelines or let the foundation models call APIs. Most recently, TaskMatrix.AI (Liang et al., 2023)
Tool Learning with Foundation Models