Efficient Tool Use with Chain-of-Abstraction Reasoning
To achieve faithful reasoning that aligns with human expectations, large
language models (LLMs) need to ground their reasoning to real-world knowledge
(e.g., web facts, math and physical rules). Tools help LLMs access this
external knowledge, but there remains challenges for fine-tuning LLM agents
(e.g., Toolformer) to invoke tools in multi-step reasoning problems, where
inter-connected tool calls require holistic and efficient tool usage planning.
  In this work, we propose a new method for LLMs to better leverage tools in
multi-step reasoning. Our method, Chain-of-Abstraction (CoA), trains LLMs to
first decode reasoning chains with abstract placeholders, and then call domain
tools to reify each reasoning chain by filling in specific knowledge. This
planning with abstract chains enables LLMs to learn more general reasoning
strategies, which are robust to shifts of domain knowledge (e.g., math results)
relevant to different reasoning questions. It also allows LLMs to perform
decoding and calling of external tools in parallel, which avoids the inference
delay caused by waiting for tool responses. In mathematical reasoning and Wiki
QA domains, we show that our method consistently outperforms previous
chain-of-thought and tool-augmented baselines on both in-distribution and
out-of-distribution test sets, with an average ~6% absolute QA accuracy
improvement. LLM agents trained with our method also show more efficient tool
use, with inference speed being on average ~1.4x faster than baseline
tool-augmented LLMs.
65bb0b7d00e143d672a7809a
Silin Gao
admin_assigned
2024-02-01T11:23:35.393Z
64b72786f53ae848e71af455
/avatars/b69326b9e5b3c0ef4f67010f9aa100f2.svg
Silin Gao
user
Silin159
65bb0b7d00e143d672a7809b
Jane Dwivedi-Yu
65bb0b7d00e143d672a7809c
Ping Yu
admin_assigned
2024-02-01T11:24:02.909Z
646c004e31968a60a022590e
/avatars/349e2ed4feef1be050fd9903dccec1e1.svg
Ping Yu
user
pingyu
65bb0b7d00e143d672a7809d
Xiaoqing Ellen Tan
admin_assigned
2024-02-01T11:24:40.357Z
6345ab8ffe134dfd7a0d1059
/avatars/159a364ac4f8a2ed001346d4cbb7f2e3.svg
Ellen Tan
user
ellenxtan
65bb0b7d00e143d672a7809e
Ramakanth Pasunuru
admin_assigned
2024-02-01T11:24:49.442Z
63b4be2334df1f9a90a1983c
/avatars/9cdfa3492c87aabdacab684b80628f14.svg
Ramakanth Pasunuru
user
rpasunuru
65bb0b7d00e143d672a7809f
Olga Golovneva
admin_assigned
2024-02-01T11:24:56.136Z
6318b1e06e6bd039440871d6
/avatars/2d9f96eb4092a9d1734dcc09303b259a.svg
Olga Golovneva
user
Golovneva
65bb0b7d00e143d672a780a0
Koustuv Sinha
admin_assigned
2024-02-01T11:25:02.849Z
622b93067b9143726fbedc37
https://cdn-avatars.huggingface.co/v1/production/uploads/1647023505150-622b93067b9143726fbedc37.jpeg
Koustuv Sinha
user
koustuvs
65bb0b7d00e143d672a780a1
Asli Celikyilmaz
65bb0b7d00e143d672a780a2
Antoine Bosselut
admin_assigned
2024-02-01T11:26:57.536Z
654fb1c67490049d621516fb
/avatars/0f88177da236b1bce4a4a58fd0246884.svg
Antoine Bosselut
user
atcbosselut
65bb0b7d00e143d672a780a3
Tianlu Wang
admin_assigned
2024-02-01T11:27:04.110Z
63f6a0e6b4c9a104f4b95d86
/avatars/660c3e44bea976f3e0560bf95466b03c.svg
Tianlu Wang
user
Tianlu
Efficient Tool Use with Chain-of-Abstraction Reasoning
To achieve faithful reasoning that aligns with human expectations, large
language models (LLMs) need to ground their reasoning to real-world knowledge
(e.g., web facts, math and physical rules). Tools help LLMs access this
external knowledge, but there remains challenges for fine-tuning LLM agents
(e.g., Toolformer) to invoke tools in multi-step reasoning problems, where
inter-connected tool calls require holistic and efficient tool usage planning.
  In this work, we propose a new method for LLMs to better leverage tools in
multi-step reasoning. Our method, Chain-of-Abstraction (CoA), trains LLMs to
first decode reasoning chains with abstract placeholders, and then call domain
tools to reify each reasoning chain by filling in specific knowledge. This
planning with abstract chains enables LLMs to learn more general reasoning
strategies, which are robust to shifts of domain knowledge (e.g., math results)
relevant to different reasoning questions. It also allows LLMs to perform
decoding and calling of external tools in parallel, which avoids the inference
delay caused by waiting for tool responses. In mathematical reasoning and Wiki
QA domains, we show that our method consistently outperforms previous
chain-of-thought and tool-augmented baselines on both in-distribution and
out-of-distribution test sets, with an average ~6% absolute QA accuracy
improvement. LLM agents trained with our method also show more efficient tool
use, with inference speed being on average ~1.4x faster than baseline
tool-augmented LLMs.
Chain-of-Abstraction (CoA) method enhances large language models' multi-step reasoning by using abstract reasoning chains to plan and efficiently invoke tools, improving accuracy and speed in tasks like mathematical reasoning and Wiki QA.
large language models LLMs Toolformer multi-step reasoning domain tools reasoning chains abstract placeholders reification general reasoning strategies chain-of-thought tool-augmented baselines QA accuracy inference speed