An A/B Testing Story
"If you work at a software company. . . you should be doing A/B testing for the same reason you have an accountant do your taxes. It is a low-risk low-investment high-certainty way to increase economic returns."<p>Spot on, and you should 100% support Patrick & Nick and buy their books / videos / etc.<p>But A/B testing is not as simple as hiring an accountant, running A/B testing as part of your corporate culture requires:<p>- Front end developer to install / manage testing engine.<p>- UX designer to measure / understand where holes may be in your flow.<p>- Competent web designer to execute instructions from UX designer.<p>- Statistically sound processes to know when to "call" a test (no Optimizely does NOT do this)<p>- SEO / marketing people to make sure that your A/B test didn't just break marketing flow<p>- etc<p>Yes, anybody could go run a headline test.<p>But running A/B testing with any sort of regularity, scale, and success is a complicated problem.