Towards Human-AI Collaboration in Healthcare: Guided Deferral Systems with Large Language Models
<|reference_start|>Towards Human-AI Collaboration in Healthcare: Guided Deferral Systems with Large Language Models: Large language models (LLMs) present a valuable technology for various applications in healthcare, but their tendency to hallucinate introduces unacceptable uncertainty in critical decision-making situations. Human-AI collaboration (HAIC) can mitigate this uncertainty by combining human and AI strengths for better outcomes. This paper presents a novel guided deferral system that provides intelligent guidance when AI defers cases to human decision-makers. We leverage LLMs' verbalisation capabilities and internal states to create this system, demonstrating that fine-tuning small-scale LLMs with data from large-scale LLMs greatly enhances performance while maintaining computational efficiency and data privacy. A pilot study showcases the effectiveness of our proposed deferral system.<|reference_end|>
@article{strong2024towards,
    title={Towards Human-AI Collaboration in Healthcare: Guided Deferral Systems
  with Large Language Models},
    author={Joshua Strong, Qianhui Men, Alison Noble},
    journal={arXiv preprint arXiv:2406.07212},
    year={2024},
    archivePrefix={arXiv},
    eprint={2406.07212},
    primaryClass={cs.CL cs.AI cs.HC}
}