Challenges and Observations.
In this section, we explore the four main challenges that we identi-
ﬁed during our analysis of the generated datasets. Our observations shed light on some interesting
aspects of cooperative AI and the difﬁculties that arise in its development. Figure 6 shows examples
of each of the four challenges discussed below.

• Role Flipping: One challenge we encountered was role ﬂipping, where the assistant and
user switch roles during the conversation. This issue typically arises when the assistant starts
providing instructions or commands instead of following the user’s prompts, which can lead
to confusion and a reversal of roles. To avoid role ﬂipping, it is crucial for the assistant not
to ask questions, as this can also contribute to the problem.

• Assistant Repeats Instruction: Another challenge that we observed was the assis-

tant simply repeating the user’s instructions without any role ﬂipping occurring.
CAMEL- Communicative Agents for “Mind” Exploration of Large Scale Language Model Society