How Optimizely Almost Got Me Fired (2014)
A/B testing is high on hype and promise but low on actual results if you follow it though to actual metrics. I've done various forms of A/B throughout most of my career and found them to be cinsistent with the OP's results.A much better approach is to install significant instrumentation and actually talk to users about what's wrong with your sign up form.That, or actually build a product that users want instead of chasing after pointless metrics. I mean, really, you think changing the color of text or a call-out is going to make up for huge deficiencies in your product or make people buy it? The entire premise seems illogical and just doesn't work. The only time I've seen a/b tests truly help was when it accidentally fixed some cross browser issue or moved a button within reach of a user.Most of the A/B website optimization industry is an elaborate scam, put off on people who don't know any better and are looking for a magic bullet.