RTP-LX: Can LLMs Evaluate Toxicity in Multilingual Scenarios?
<|reference_start|>RTP-LX: Can LLMs Evaluate Toxicity in Multilingual Scenarios?: Large language models (LLMs) and small language models (SLMs) are being adopted at remarkable speed, although their safety still remains a serious concern. With the advent of multilingual S/LLMs, the question now becomes a matter of scale: can we expand multilingual safety evaluations of these models with the same velocity at which they are deployed? To this end we introduce RTP-LX, a human-transcreated and human-annotated corpus of toxic prompts and outputs in 28 languages. RTP-LX follows participatory design practices, and a portion of the corpus is especially designed to detect culturally-specific toxic language. We evaluate seven S/LLMs on their ability to detect toxic content in a culturally-sensitive, multilingual scenario. We find that, although they typically score acceptably in terms of accuracy, they have low agreement with human judges when judging holistically the toxicity of a prompt, and have difficulty discerning harm in context-dependent scenarios, particularly with subtle-yet-harmful content (e.g. microagressions, bias). We release of this dataset to contribute to further reduce harmful uses of these models and improve their safe deployment.<|reference_end|>
@article{de wynter2024rtp-lx:,
    title={RTP-LX: Can LLMs Evaluate Toxicity in Multilingual Scenarios?},
    author={Adrian de Wynter, Ishaan Watts, Nektar Ege Alt{i}ntoprak, Tua
  Wongsangaroonsri, Minghui Zhang, Noura Farra, Lena Baur, Samantha Claudet,
  Pavel Gajdusek, Can G"oren, Qilong Gu, Anna Kaminska, Tomasz Kaminski, Ruby
  Kuo, Akiko Kyuba, Jongho Lee, Kartik Mathur, Petter Merok, Ivana
  Milovanovi'c, Nani Paananen, Vesa-Matti Paananen, Anna Pavlenko, Bruno
  Pereira Vidal, Luciano Strika, Yueh Tsao, Davide Turcato, Oleksandr Vakhno,
  Judit Velcsov, Anna Vickers, St'ephanie Visser, Herdyan Widarmanto, Andrey
  Zaikin, Si-Qing Chen},
    journal={arXiv preprint arXiv:2404.14397},
    year={2024},
    archivePrefix={arXiv},
    eprint={2404.14397},
    primaryClass={cs.CL cs.CY cs.LG}
}