LMOD: A Large Multimodal Ophthalmology Dataset and Benchmark for Large Vision-Language Models
<|reference_start|>LMOD: A Large Multimodal Ophthalmology Dataset and Benchmark for Large Vision-Language Models: Ophthalmology relies heavily on detailed image analysis for diagnosis and treatment planning. While large vision-language models (LVLMs) have shown promise in understanding complex visual information, their performance on ophthalmology images remains underexplored. We introduce LMOD, a dataset and benchmark for evaluating LVLMs on ophthalmology images, covering anatomical understanding, diagnostic analysis, and demographic extraction. LMODincludes 21,993 images spanning optical coherence tomography, scanning laser ophthalmoscopy, eye photos, surgical scenes, and color fundus photographs. We benchmark 13 state-of-the-art LVLMs and find that they are far from perfect for comprehending ophthalmology images. Models struggle with diagnostic analysis and demographic extraction, reveal weaknesses in spatial reasoning, diagnostic analysis, handling out-of-domain queries, and safeguards for handling biomarkers of ophthalmology images.<|reference_end|>
@article{qin2024lmod:,
    title={LMOD: A Large Multimodal Ophthalmology Dataset and Benchmark for Large
  Vision-Language Models},
    author={Zhenyue Qin, Yu Yin, Dylan Campbell, Xuansheng Wu, Ke Zou, Yih-Chung
  Tham, Ninghao Liu, Xiuzhen Zhang, Qingyu Chen},
    journal={arXiv preprint arXiv:2410.01620},
    year={2024},
    archivePrefix={arXiv},
    eprint={2410.01620},
    primaryClass={cs.CV}
}