Software updates: the “unknown unknown” of the replication crisis
I&#x27;ll concede that the story is different when you&#x27;re relying on commercial software that you&#x27;ve purchased to implement an algorithm correctly, but in the limited case of replicating results (whether they&#x27;re flawed or not), the onus really should be on the user to record what version of software they&#x27;re using and how they configured it. The article does a lot of gymnastics to make software correctness and research reproducibility feel like the same issue.