$\textitBenchIE^FL$ : A Manually Re-Annotated Fact-Based Open Information Extraction Benchmark
<|reference_start|>$\textitBenchIE^FL$ : A Manually Re-Annotated Fact-Based Open Information Extraction Benchmark: Open Information Extraction (OIE) is a field of natural language processing that aims to present textual information in a format that allows it to be organized, analyzed and reflected upon. Numerous OIE systems are developed, claiming ever-increasing performance, marking the need for objective benchmarks. BenchIE is the latest reference we know of. Despite being very well thought out, we noticed a number of issues we believe are limiting. Therefore, we propose $\textit{BenchIE}^{FL}$, a new OIE benchmark which fully enforces the principles of BenchIE while containing fewer errors, omissions and shortcomings when candidate facts are matched towards reference ones. $\textit{BenchIE}^{FL}$ allows insightful conclusions to be drawn on the actual performance of OIE extractors.<|reference_end|>
@article{lamarche2024$\textit{benchie}^{fl}$,
    title={$\textit{BenchIE}^{FL}$ : A Manually Re-Annotated Fact-Based Open
  Information Extraction Benchmark},
    author={Fabrice Lamarche, Philippe Langlais},
    journal={arXiv preprint arXiv:2407.16860},
    year={2024},
    archivePrefix={arXiv},
    eprint={2407.16860},
    primaryClass={cs.CL}
}