OAEI-LLM: A Benchmark Dataset for Understanding Large Language Model Hallucinations in Ontology Matching
<|reference_start|>OAEI-LLM: A Benchmark Dataset for Understanding Large Language Model Hallucinations in Ontology Matching: Hallucinations of large language models (LLMs) commonly occur in domain-specific downstream tasks, with no exception in ontology matching (OM). The prevalence of using LLMs for OM raises the need for benchmarks to better understand LLM hallucinations. The OAEI-LLM dataset is an extended version of the Ontology Alignment Evaluation Initiative (OAEI) datasets that evaluate LLM-specific hallucinations in OM tasks. We outline the methodology used in dataset construction and schema extension, and provide examples of potential use cases.<|reference_end|>
@article{qiang2024oaei-llm:,
    title={OAEI-LLM: A Benchmark Dataset for Understanding Large Language Model
  Hallucinations in Ontology Matching},
    author={Zhangcheng Qiang, Kerry Taylor, Weiqing Wang, Jing Jiang},
    journal={arXiv preprint arXiv:2409.14038},
    year={2024},
    archivePrefix={arXiv},
    eprint={2409.14038},
    primaryClass={cs.AI cs.CL cs.IR}
}