Promoting Equality in Large Language Models: Identifying and Mitigating the Implicit Bias based on Bayesian Theory
<|reference_start|>Promoting Equality in Large Language Models: Identifying and Mitigating the Implicit Bias based on Bayesian Theory: Large language models (LLMs) are trained on extensive text corpora, which inevitably include biased information. Although techniques such as Affective Alignment can mitigate some negative impacts of these biases, existing prompt-based attack methods can still extract these biases from the model's weights. Moreover, these biases frequently appear subtly when LLMs are prompted to perform identical tasks across different demographic groups, thereby camouflaging their presence. To address this issue, we have formally defined the implicit bias problem and developed an innovative framework for bias removal based on Bayesian theory, Bayesian-Theory based Bias Removal (BTBR). BTBR employs likelihood ratio screening to pinpoint data entries within publicly accessible biased datasets that represent biases inadvertently incorporated during the LLM training phase. It then automatically constructs relevant knowledge triples and expunges bias information from LLMs using model editing techniques. Through extensive experimentation, we have confirmed the presence of the implicit bias problem in LLMs and demonstrated the effectiveness of our BTBR approach.<|reference_end|>
@article{deng2024promoting,
    title={Promoting Equality in Large Language Models: Identifying and Mitigating
  the Implicit Bias based on Bayesian Theory},
    author={Yongxin Deng (1), Xihe Qiu (1), Xiaoyu Tan (2), Jing Pan (3), Chen Jue
  (1), Zhijun Fang (4), Yinghui Xu (5), Wei Chu (2), Yuan Qi (5) ((1) Shanghai
  University of Engineering Science, (2) INF Technology (Shanghai) Co., Ltd.,
  (3) Monash University, (4) Donghua University, (5) Fudan University)},
    journal={arXiv preprint arXiv:2408.10608},
    year={2024},
    archivePrefix={arXiv},
    eprint={2408.10608},
    primaryClass={cs.CL cs.AI}
}