factgenie: A Framework for Span-based Evaluation of Generated Texts
<|reference_start|>factgenie: A Framework for Span-based Evaluation of Generated Texts: We present factgenie: a framework for annotating and visualizing word spans in textual model outputs. Annotations can capture various span-based phenomena such as semantic inaccuracies or irrelevant text. With factgenie, the annotations can be collected both from human crowdworkers and large language models. Our framework consists of a web interface for data visualization and gathering text annotations, powered by an easily extensible codebase.<|reference_end|>
@article{kasner2024factgenie:,
    title={factgenie: A Framework for Span-based Evaluation of Generated Texts},
    author={Zdenv{e}k Kasner, Ondv{r}ej Pl'atek, Patr'icia Schmidtov'a,
  Simone Balloccu, Ondv{r}ej Duv{s}ek},
    journal={arXiv preprint arXiv:2407.17863},
    year={2024},
    archivePrefix={arXiv},
    eprint={2407.17863},
    primaryClass={cs.CL}
}