RULE: Reliable Multimodal RAG for Factuality in Medical Vision Language
  Models
The recent emergence of Medical Large Vision Language Models (Med-LVLMs) has
enhanced medical diagnosis. However, current Med-LVLMs frequently encounter
factual issues, often generating responses that do not align with established
medical facts. Retrieval-Augmented Generation (RAG), which utilizes external
knowledge, can improve the factual accuracy of these models but introduces two
major challenges. First, limited retrieved contexts might not cover all
necessary information, while excessive retrieval can introduce irrelevant and
inaccurate references, interfering with the model's generation. Second, in
cases where the model originally responds correctly, applying RAG can lead to
an over-reliance on retrieved contexts, resulting in incorrect answers. To
address these issues, we propose RULE, which consists of two components. First,
we introduce a provably effective strategy for controlling factuality risk
through the calibrated selection of the number of retrieved contexts. Second,
based on samples where over-reliance on retrieved contexts led to errors, we
curate a preference dataset to fine-tune the model, balancing its dependence on
inherent knowledge and retrieved contexts for generation. We demonstrate the
effectiveness of RULE on three medical VQA datasets, achieving an average
improvement of 20.8% in factual accuracy. We publicly release our benchmark and
code in https://github.com/richard-peng-xia/RULE.
668c8f229761c585a2d8e11d
Peng Xia
extracted_confirmed
2024-07-09T01:16:39.696Z
643e9ee6f6bb3c31a26e7bc4
/avatars/acfaa7d6a23dada24c86b954c3be116a.svg
Peng Xia
user
richardxp888
668c8f229761c585a2d8e11e
Kangyu Zhu
admin_assigned
2024-07-09T08:19:31.864Z
661af01a8ad066992403cc6f
/avatars/b4680010940a84c23521aa4b043ccab4.svg
Kangyu Zhu
user
zky11235
668c8f229761c585a2d8e11f
Haoran Li
claimed_verified
2024-07-09T09:27:10.729Z
64e86d6e7ef2c72cbcdb27b7
https://cdn-avatars.huggingface.co/v1/production/uploads/64e86d6e7ef2c72cbcdb27b7/RLuJJ1xuO665LMWneVDZz.jpeg
Haoran Li
user
brian13
668c8f229761c585a2d8e120
Hongtu Zhu
668c8f229761c585a2d8e121
Yun Li
668c8f229761c585a2d8e122
Gang Li
668c8f229761c585a2d8e123
Linjun Zhang
668c8f229761c585a2d8e124
Huaxiu Yao
admin_assigned
2024-07-09T08:20:16.465Z
65f667a455009c4ad9e6ac4c
/avatars/ed10c2cf2ba3fde6d7da93f076961607.svg
Yao
user
Huaxiu
RULE: Reliable Multimodal RAG for Factuality in Medical Vision Language
  Models
The recent emergence of Medical Large Vision Language Models (Med-LVLMs) has
enhanced medical diagnosis. However, current Med-LVLMs frequently encounter
factual issues, often generating responses that do not align with established
medical facts. Retrieval-Augmented Generation (RAG), which utilizes external
knowledge, can improve the factual accuracy of these models but introduces two
major challenges. First, limited retrieved contexts might not cover all
necessary information, while excessive retrieval can introduce irrelevant and
inaccurate references, interfering with the model's generation. Second, in
cases where the model originally responds correctly, applying RAG can lead to
an over-reliance on retrieved contexts, resulting in incorrect answers. To
address these issues, we propose RULE, which consists of two components. First,
we introduce a provably effective strategy for controlling factuality risk
through the calibrated selection of the number of retrieved contexts. Second,
based on samples where over-reliance on retrieved contexts led to errors, we
curate a preference dataset to fine-tune the model, balancing its dependence on
inherent knowledge and retrieved contexts for generation. We demonstrate the
effectiveness of RULE on three medical VQA datasets, achieving an average
improvement of 20.8% in factual accuracy. We publicly release our benchmark and
code in https://github.com/richard-peng-xia/RULE.
RULE improves factual accuracy in Medical Large Vision Language Models by calibrating retrieved context selection and fine-tuning model preference.
Medical Large Vision Language Models Med-LVLMs Retrieval-Augmented Generation RAG factuality risk preference dataset