Are LLMs Rational Investors? A Study on Detecting and Reducing the Financial Bias in LLMs
<|reference_start|>Are LLMs Rational Investors? A Study on Detecting and Reducing the Financial Bias in LLMs: Large Language Models (LLMs) are increasingly adopted in financial analysis for interpreting complex market data and trends. However, their use is challenged by intrinsic biases (e.g., risk-preference bias) and a superficial understanding of market intricacies, necessitating a thorough assessment of their financial insight. To address these issues, we introduce Financial Bias Indicators (FBI), a framework with components like Bias Unveiler, Bias Detective, Bias Tracker, and Bias Antidote to identify, detect, analyze, and eliminate irrational biases in LLMs. By combining behavioral finance principles with bias examination, we evaluate 23 leading LLMs and propose a de-biasing method based on financial causal knowledge. Results show varying degrees of financial irrationality among models, influenced by their design and training. Models trained specifically on financial datasets may exhibit more irrationality, and even larger financial language models (FinLLMs) can show more bias than smaller, general models. We utilize four prompt-based methods incorporating causal debiasing, effectively reducing financial biases in these models. This work enhances the understanding of LLMs' bias in financial applications, laying the foundation for developing more reliable and rational financial analysis tools.<|reference_end|>
@article{zhou2024are,
    title={Are LLMs Rational Investors? A Study on Detecting and Reducing the
  Financial Bias in LLMs},
    author={Yuhang Zhou and Yuchen Ni and Yunhui Gan and Zhangyue Yin and Xiang
  Liu and Jian Zhang and Sen Liu and Xipeng Qiu and Guangnan Ye and Hongfeng
  Chai},
    journal={arXiv preprint arXiv:2402.12713},
    year={2024},
    archivePrefix={arXiv},
    eprint={2402.12713},
    primaryClass={cs.CL}
}