Multi-turn interactive conversation. The capability of multi-turn conversation is the foundation of
effective and consistent communication. As the core of the brain module, LLMs, such as GPT series
[40; 41; 201], LLaMA series [201; 209] and T5 series [107; 210], can understand natural language
and generate coherent and contextually relevant responses, which helps agents to comprehend better
and handle various problems [211]. However, even humans find it hard to communicate without
confusion in one sitting, so multiple rounds of dialogue are necessary. Compared with traditional
text-only reading comprehension tasks like SQuAD [212], multi-turn conversations (1) are interactive,
involving multiple speakers, and lack continuity; (2) may involve multiple topics, and the information
of the dialogue may also be redundant, making the text structure more complex [147]. In general, the
multi-turn conversation is mainly divided into three steps: (1) Understanding the history of natural
TheRiseandPotentialofLargeLanguageModel BasedAgents