Number of Messages is low indicating that the limit of 40 maximum messages is reasonable.
We study the effect of the prompt design on the conversation termination distribution. We design
Prompt V2 which modiﬁes the original AI society prompt by removing the assistant response format
i.e. starting with “Solution” and asking for “Next request”. The second ablation adds a task planner to
the original prompt. As seen in Figure 8, we notice that both modiﬁcations considerably increases the
number of conversations that terminate with end of task token, and reduce the number of messages
with assistant instruction. However, we observe a signiﬁcant increase in the number of ﬂake messages
for Prompt V2 and Prompt V1 + Task Planner compared to original Prompt V1 as seen in Figure 9.
Figures 10 and 11 show the information cartography of the instructions and tasks obtained for AI
Society respectively. The subjects covered in AI Society cover a wide range of technicality. Topics
CAMEL- Communicative Agents for “Mind” Exploration of Large Scale Language Model Society