Ruby Teaming: Improving Quality Diversity Search with Memory for Automated Red Teaming
<|reference_start|>Ruby Teaming: Improving Quality Diversity Search with Memory for Automated Red Teaming: We propose Ruby Teaming, a method that improves on Rainbow Teaming by including a memory cache as its third dimension. The memory dimension provides cues to the mutator to yield better-quality prompts, both in terms of attack success rate (ASR) and quality diversity. The prompt archive generated by Ruby Teaming has an ASR of 74%, which is 20% higher than the baseline. In terms of quality diversity, Ruby Teaming outperforms Rainbow Teaming by 6% and 3% on Shannon's Evenness Index (SEI) and Simpson's Diversity Index (SDI), respectively.<|reference_end|>
@article{han2024ruby,
    title={Ruby Teaming: Improving Quality Diversity Search with Memory for
  Automated Red Teaming},
    author={Vernon Toh Yan Han, Rishabh Bhardwaj, Soujanya Poria},
    journal={arXiv preprint arXiv:2406.11654},
    year={2024},
    archivePrefix={arXiv},
    eprint={2406.11654},
    primaryClass={cs.CL}
}