2022) to conduct safety evaluations of LLMs using a Chain of Utterances (CoU)-based prompt.

Besides automated benchmarks, an important measure for safety is human evaluation (Dai et al.,
2023), where crowdworkers label the responses as safe or harmful. Some studies also attempt to
collect such labels from GPT-4, as research shows that it can replace human evaluators in evaluating
alignment abilities (Chiang & Lee, 2023).
ChatGPT’sOne-yearAnniversary-AreOpen-Source LargeLanguageModelsCatchingup