Almost didn&#x27;t click on this because the title seems (and is) clickbait-y, but it was actually a very useful read for me.<p>As a founder, I&#x27;m constantly hearing about A&#x2F;B testing and how great these tools are. I&#x27;m not enough of a statistician to know whether everything in this article is true&#x2F;valid (and would welcome a rebuttal), but the part about regression to the mean really hits home. Encouraging users to cut off testing too early means that you make them feel good (&quot;Look, we had this huge difference!&quot;), when in reality the difference is smaller&#x2F;negligible.<p>I&#x27;ll still do some A&#x2F;B testing, but given our engineering&#x2F;time constraints—and my inability to accurately vet the claims&#x2F;conclusions of the testing software—I won&#x27;t spend too much time on this.