content_image/295451.jpg
<img src='content_image/295451.jpg'>

## 1 6 Comparison to conventional approaches to multiple versions: F-tests and Bonferroni correction 

The method described in § 5.2 makes an important trade-off: it prioritizes the primary comparison against all controls under the assumption of a constant treatment effect, al- lowing us to report the corresponding confidence interval with no correction, in exchange for the ability to distinguish between versions if they do, in fact, exists. In other words, our method emphasizes detection of non-zero, constant treatment effects over detecting different versions of the effect. Conventional approaches to multiple comparisons, are of- 

