GPT's Judgements Under Uncertainty
<|reference_start|>GPT's Judgements Under Uncertainty: We investigate whether biases inherent in human cognition, such as loss aversion, framing effects, and conjunction fallacy, manifest in how GPT-4o judges and makes decisions in probabilistic scenarios. By conducting 1350 experiments across nine cognitive biases and analyzing the responses for statistical versus heuristic reasoning, we demonstrate GPT-4o's contradicting approach while responding to prompts with similar underlying probability notations. Our findings also reveal mixed performances with the AI demonstrating both human-like heuristic errors and statistically sound decisions, even as it goes through identical iterations of the same prompt.<|reference_end|>
@article{saeedi2024gpt's,
    title={GPT's Judgements Under Uncertainty},
    author={Payam Saeedi and Mahsa Goodarzi},
    journal={arXiv preprint arXiv:2410.02820},
    year={2024},
    archivePrefix={arXiv},
    eprint={2410.02820},
    primaryClass={cs.AI cs.CL cs.LG}
}