Sociability.
In addition to the utility of LLM-based agents in task completion and meeting human
needs, their sociability is also crucial [8]. It influences user communication experiences and sig-
nificantly impacts communication efficiency, involving whether they can seamlessly interact with
humans and other agents [206; 498; 586]. Specifically, the evaluation of sociability can be approached
from the following perspectives: (1) language communication proficiency is a fundamental capability
encompassing both natural language understanding and generation. It has been a longstanding focus
in the NLP community. Natural language understanding requires the agent to not only comprehend
literal meanings but also grasp implied meanings and relevant social knowledge, such as humor, irony,
aggression, and emotions [487; 587; 588]. On the other hand, natural language generation demands
the agent to produce fluent, grammatically correct, and credible content while adapting appropriate
TheRiseandPotentialofLargeLanguageModel BasedAgents