4This point was also made for preregistration in epidemi-

ology by Sørensen and Rothman (2010).

5See Loder et al. (2010) for arguments from epidemiology.
6Selective reporting is regarded the most important contrib-
utor to irreproducibility by Baker (2016). Nosek et al. (2018),
advocating for preregistration, presents similar arguments.

7This practice refers to when researchers make decisions
about which correlation tests to conduct based on properties of
their data. The practice is named after The Garden of Forking
Paths , a 1941 short story by Jorge Luis Borges.

8Workshops on preregistration at ICCV 2019 (https://
preregister.vision/) and at NeurIPS 2021 (https:
//preregister.science/) seemingly did not lead to
publications or a change in practice yet, but the website for
the 2021 workshop says papers are forthcoming.

9Gundersen (2021) complains no AI venues support pre-

registration, but provide no arguments for or against it.
A Two-Sided Discussion of Preregistration of NLP Research