GitBug-Java: A Reproducible Benchmark of Recent Java Bugs
<|reference_start|>GitBug-Java: A Reproducible Benchmark of Recent Java Bugs: Bug-fix benchmarks are essential for evaluating methodologies in automatic program repair (APR) and fault localization (FL). However, existing benchmarks, exemplified by Defects4J, need to evolve to incorporate recent bug-fixes aligned with contemporary development practices. Moreover, reproducibility, a key scientific principle, has been lacking in bug-fix benchmarks. To address these gaps, we present GitBug-Java, a reproducible benchmark of recent Java bugs. GitBug-Java features 199 bugs extracted from the 2023 commit history of 55 notable open-source repositories. The methodology for building GitBug-Java ensures the preservation of bug-fixes in fully-reproducible environments. We publish GitBug-Java at https://github.com/gitbugactions/gitbug-java.<|reference_end|>
@article{silva2024gitbug-java:,
    title={GitBug-Java: A Reproducible Benchmark of Recent Java Bugs},
    author={Andr'e Silva, Nuno Saavedra, Martin Monperrus},
    journal={Proceedings of Mining Software Repositories Conference (MSR), 2024},
    year={2024},
    doi={10.1145/3643991.3644884},
    archivePrefix={arXiv},
    eprint={2402.02961},
    primaryClass={cs.SE}
}