So how would you test things differently? I&#x27;m not being facetious here: you sound like you have a good grasp of statistics, and I only have a minor in math (and a love of good number crunching).<p>At the end of the day, we need to be able to tell management that we believe the change had this big of an effect, within these errors bars. Management need that in order to make financial decisions. They aren&#x27;t dumb, but they also can&#x27;t be expected to have a masters in statistics.