GradBias: Unveiling Word Influence on Bias in Text-to-Image Generative Models
<|reference_start|>GradBias: Unveiling Word Influence on Bias in Text-to-Image Generative Models: Recent progress in Text-to-Image (T2I) generative models has enabled high-quality image generation. As performance and accessibility increase, these models are gaining significant attraction and popularity: ensuring their fairness and safety is a priority to prevent the dissemination and perpetuation of biases. However, existing studies in bias detection focus on closed sets of predefined biases (e.g., gender, ethnicity). In this paper, we propose a general framework to identify, quantify, and explain biases in an open set setting, i.e. without requiring a predefined set. This pipeline leverages a Large Language Model (LLM) to propose biases starting from a set of captions. Next, these captions are used by the target generative model for generating a set of images. Finally, Vision Question Answering (VQA) is leveraged for bias evaluation. We show two variations of this framework: OpenBias and GradBias. OpenBias detects and quantifies biases, while GradBias determines the contribution of individual prompt words on biases. OpenBias effectively detects both well-known and novel biases related to people, objects, and animals and highly aligns with existing closed-set bias detection methods and human judgment. GradBias shows that neutral words can significantly influence biases and it outperforms several baselines, including state-of-the-art foundation models. Code available here: https://github.com/Moreno98/GradBias.<|reference_end|>
@article{d'incà2024gradbias:,
    title={GradBias: Unveiling Word Influence on Bias in Text-to-Image Generative
  Models},
    author={Moreno D'Inc`a, Elia Peruzzo, Massimiliano Mancini, Xingqian Xu,
  Humphrey Shi, Nicu Sebe},
    journal={arXiv preprint arXiv:2408.16700},
    year={2024},
    archivePrefix={arXiv},
    eprint={2408.16700},
    primaryClass={cs.CV}
}