How Optimizely Almost Got Me Fired (2014)
A&#x2F;B testing is high on hype and promise but low on actual results if you follow it though to actual metrics. I&#x27;ve done various forms of A&#x2F;B throughout most of my career and found them to be cinsistent with the OP&#x27;s results.<p>A much better approach is to install significant instrumentation and actually talk to users about what&#x27;s wrong with your sign up form.<p>That, or actually build a product that users want instead of chasing after pointless metrics. I mean, really, you think changing the color of text or a call-out is going to make up for huge deficiencies in your product or make people buy it? The entire premise seems illogical and just doesn&#x27;t work. The only time I&#x27;ve seen a&#x2F;b tests truly help was when it accidentally fixed some cross browser issue or moved a button within reach of a user.<p>Most of the A&#x2F;B website optimization industry is an elaborate scam, put off on people who don&#x27;t know any better and are looking for a magic bullet.