Against The Achilles' Heel: A Survey on Red Teaming for Generative Models
<|reference_start|>Against The Achilles' Heel: A Survey on Red Teaming for Generative Models: Generative models are rapidly gaining popularity and being integrated into everyday applications, raising concerns over their safety issues as various vulnerabilities are exposed. Faced with the problem, the field of red teaming is experiencing fast-paced growth, which highlights the need for a comprehensive organization covering the entire pipeline and addressing emerging topics for the community. Our extensive survey, which examines over 120 papers, introduces a taxonomy of fine-grained attack strategies grounded in the inherent capabilities of language models. Additionally, we have developed the searcher framework that unifies various automatic red teaming approaches. Moreover, our survey covers novel areas including multimodal attacks and defenses, risks around multilingual models, overkill of harmless queries, and safety of downstream applications. We hope this survey can provide a systematic perspective on the field and unlock new areas of research.<|reference_end|>
@article{lin2024against,
    title={Against The Achilles' Heel: A Survey on Red Teaming for Generative
  Models},
    author={Lizhi Lin and Honglin Mu and Zenan Zhai and Minghan Wang and Yuxia
  Wang and Renxi Wang and Junjie Gao and Yixuan Zhang and Wanxiang Che and
  Timothy Baldwin and Xudong Han and Haonan Li},
    journal={arXiv preprint arXiv:2404.00629},
    year={2024},
    archivePrefix={arXiv},
    eprint={2404.00629},
    primaryClass={cs.CL}
}