[{"document_url": "https://thenextweb.com/insider/2015/09/15/how-to-ab-test-your-email/", "unformatted_src": "https://cdn0.tnwcdn.com/wp-content/blogs.dir/1/files/2015/09/ab-testing-1200x615.jpg", "src": "https://cdn0.tnwcdn.com/wp-content/blogs.dir/1/files/2015/09/ab-testing-1200x615.jpg", "formatted_filename": "ab testing", "alt_text": "How to A/B test your email"}, null]
Thereâs no denying that email marketing is still the most effective way to sell online.

Given how powerful email is, along with the sheer number of âhow toâ posts about it, itâs tempting to build your efforts around established best practices or simply use your platforms recommended features.

Here be gadgets

Not here exactly, but on our new hardware site Plugged.


Unfortunately, that approach has failed time and time again.Â Instead, testing â rigorous, methodical, and data-driven A/B testing â is absolutely essential.Â But where should you start?Â To answer that question, Iâve put together this list of 15 A/B tests you can jump into today.

First, a quick note â¦

Lots of email testing tools exist and the provider you choose must be able to actually run the tests outlined below. This is especially true for testing content blocks (tests five-eight) and calls-to-action (tests 9-12). Additionally, be sure to preview the providerâs analytics to ensure the results of your A/B tests are easy to read and evaluate.

Image via GetResponse

Regardless of the provider you choose, letâs get into the 15 most crucial A/B tests.

Subject Lines

Subject lines are the most important element of any email. Why? Because your subject line isnât just what people see first, for the majority of your audience, itâs all they see. According to Smart Insights, the average open rate for the âMarketing and Advertisingâ industry is 18.6 percent. That means, with the wrong subject line, over 80 percent of your subscribers will never even see whatâs inside.

Numerous studies have focused on the optimal length of subject lines. Collectively, they lead to one definitive conclusion â¦ there is no definitive conclusion.Â The only thing that seems certain is that itâs best to have very short (less than 49 characters) or very long (60-70 characters) subject lines, but each brand does have its own sweet spot.

To start, try testing one-three word subject lines with less than 50 characters against those up to 70 characters long and see what your audience prefers.

If you have a great relationship with your fans and readers, a conversational subject line that sounds like itâs coming from a friend may be the way to go.Â For example, when tragedy struck, Buffer decided to ditch the corporate speak and go with, âBuffer has been hacked â here is whatâs going onâ for their email announcement.

In other words, try using subject lines with product or industry keywords along with phrases such as âFree Deliveryâ or â20% Offâ against the far more conversational subject lines of a brand like JackThreads: âSo, Before you go out tonightâ¦â âP-A-R-Tâ¦Y? Because I gotta.â or even just âYour Girlfriendâ¦â

âRough day?âÂ Thatâs the simple question Sephora asked in one of their emails. And at 4 PM on a Monday, youâre bound to click it because yes, you have had a rough day. Youâre intrigued.Â On the other hand, âHereâs how to relax after a stressful dayâ¦â may have also gotten your attention. With this approach, you know for sure the answer is just a click away.

Youâd think that only entertainment brands would be able to pull off a fun, witty subject line, but youâd be wrong.

A reminder to refill a prescription could say, âItâs Time to Refill Your Prescriptionâ or you could go Warby Parkerâs route with âUh oh, your prescription is expiringâ. (Note that they still manage to fit the essential words in there, even while being unconventional.)

Nothing is more appealing than a brand thatâs expected to be formal and functional busting out a witty one-liner, like Customer Surveyâs âBaby Got (Feed) Backâ.Â Your audience could be pleasantly surprised if you injected a little humour, but there is only one way to find out.


Content is all about the meat of the matter. In other words, the body of your email.Â Once youâve gotten the elusive open, can you get your subscribers to stick around to read the rest?

While you may be tempted to get fancy with your emails by using great eye-catching templates, a plain text mail might work better for several reasons.

First, text emails, without the frills, look like theyâre coming from a friend, which might be more appealing to some readers (see conversational subject lines above).

Second, some templates wonât translate well to all screens. Approximately 53 percent of emails are opened on mobile devices, and if your subscribers canât read it, you may have just lost a purchase.

Humans are visual creatures. Online â especially on social media â photos and videos perform better than virtually all other forms of content.

However, before you go all in on this âbest practiceâ â¦ test it. If your subscriberâs email client blocks images by default, like Gmail tends to do, their experience wonât be the one youâre hoping to create. Emails with images are also very HTML heavy, which results in slower load time. Hereâs a great example of an A/B test with surprising results:


As strange as it might sound, the plain-text email on the right âincreased revenue by 303.8 percent and visits to the website by 194.51Â percent.â

If you do decide to include images in your emails, you have another choice to make. Do you use photos with just your product, like Apple and Samsung do with their devices, or do you include people using and wearing your products, the way many popular retailers like Nordstrom and Forever21 do?

Both have their merits, depending on the type of product you sell and your audience. Instead of taking a wild guess, try out both and see which one wins.

Consider these two drastically oversimplified statements:

âYou spend all day slaving to create a detailed report, only for your boss to notice somethingâs off â¦ in front of an entire meeting. This software can help.â

âWith this software, you could finish working by midday â¦ and get a raise!â

The first focuses on the pain you experience without the software, while the second focus on the pleasure you will experience once you it.Â Try phrasing your content in different ways to evoke different emotions and see which one appeals better to your audience.


So theyâve read your email, and now itâs the moment of truth.

Were they convinced enough by your content to take the next step? More to the point: how much of a role does the action button itself play in this decision?

Best practices will tell you that you should stick to one stand-out call-to-action (CTA) button with short, action-filled keywords.

There are several cases, however, when multiple call-to-action buttons might be more useful and net you better results.

If you want readers to answer a question with multiple options, you could include each option with a different link. Then you could track link clicks to determine the winning responses, instead of taking readers away from the email.

Including social media sharing options is also a great use of multiple CTAs. In such a case, not only could you track the link clicks from the email, you could use a social media management platform like Oktopost to measure the ROI from those social shares over time.

Since emails usually refer to readers in the second person, i.e. you or your, it figures that a CTA with âyourâ would perform better.

Yet, a study done by Content Verve showed that changing button text from âget your free templateâ to âget my free templateâ resulted in a 90 percent increase in clicks.

Image via Content Verve

Again, though the results worked out great in this case, it may not work in yours. Never trust a hypothesis or best practices when you can run your own tests and find out the truth.

If your email is meant to drive traffic to your latest blog post or article, you have the option of including a preview of the post along with a âRead Moreâ link or a more specific CTA such âLearn the top three ways to improve your writing.â

ProductHunt uses a specific promise to encourage clicks. Even those who didnât take the time to read the content of the email would be interested in the CTA is this email, âDiscover Free Marketing Tools.â

Image via ProductHunt (Screenshot)

Of course, this raises another important test.

Thereâs no doubt that people like a bargain, and free content gets passed around a lot online. But studies have shown that sometimes using the word âfreeâ in emails, particularly in subject lines and call-to-actions can backfire. Hereâs why â¦

The word free is used often by spammers, so many email providers tend to automatically block emails with the word. Additionally, readers are wary of clicking on âfreeâ links, even from trusted sources. In the test shown below, HubSpot found that an email without the word âfreeâ had a 17 percent higher click-through rate than the one that used âfreeâ in the subject line and CTA.

Image via HubSpot

But this doesnât mean you canât offer free items in your emails. Instead, use a friendlier substitute, such as âcomplimentaryâ, âon the houseâ or âas a giftâ, or, like HubSpot did above, you can simply offer an item without using the word at all.


Timing is everything. The time you send your email can mean the difference between landing in a trash can and landing a customer.

If youâre a B2B brand, you might see more success with an email sent in the middle of the week. A retail brand, however, might get more attention on weekends when readers are relaxing and already in the mood for shopping. Or maybe your ideal customers are stay-at-home moms who actually do the bulk of their online buying mid-week when they are home alone and have more free time to themselves.

Bottom line: it really depends on your customers and their daily schedules. The only way to find out what works is to test over time weekdays versus weekends, and then get even more granular and find which day of the week yields the best results.

The same rules apply to the time of day as they do the day of the week.

Some will tell you that early morning is best since people check their emails first thing, but if they are going through a lot of emails, they might skip yours.

Others will say that late evening or night is fine, especially if your readers are attached to their mobile devices they way many are nowadays.

Try different time windows and monitor your overall open rate, as well as the delay in open time to get the best picture. If you have very different customers, try segmenting them to make this easier, or using a tool with advanced timing control that sends out your email at the optimal time in different time zones.

Will your readers unsubscribe if you email them once a day? Will they get disengaged if you only reach out once a week?

Instead of sticking to a frequency you think may work, segment your list and test the open, click-through, and unsubscribe rates of daily versus weekly emails.

You might also want to try switching up your approach if your emails are always product-oriented. Readers might object to being sold something (or worse, the same thing) every day, but theyâll probably be more receptive with useful tips, the latest news, or other flat-out entertaining content.

Testing Everything, But Not All At Once

Youâve gotten a lot of ideas for tests here and youâre probably psyched to try them out and see what results you get, but remember not to try them all at once.

The only way to know what truly works in A/B testing is to test one element at a time, and observe it over time so you can see a distinct pattern.

If you test multiple elements, you wonât know which one is impacting the choice of your readers. And if you test only for a short time, you might see a quick jump immediately, due to the novelty, but it may level out after a while and return to normal.

Testing is best when done continuously and carefully. Do it right, and youâll always come out winning in the end.

Read Next:Â The 6 rules for creating killer email campaigns

Image credit: Shutterstock

Read next: Skype just made GIFs better by adding credits








