<http://schema.org/articleBody>
"Ad Testing: Research and Findings\nTrack: Advertising\nFocus:  Ads\nSkill: AdvancedSession Overview:\nHave you been doing deep testing of your ad campaigns? Fear not -- the panel in this session has and will be sharing tips you might want to try yourself. How important are headlines, descriptions and other elements in your control? How do consumers interact with the ads?Moderator:\n    * Gordon Hotchkiss, President &amp; CEO, Enquiro Search Solutions Inc.Speakers:\n    * Gordon Hotchkiss, President &amp; CEO, Enquiro Search Solutions Inc.\n    * Anton E. Konikoff, Founder and CEO, Acronym Media\n    * Jonathan Mendez, Founder &amp; Chief Strategy Officer, OTTO Digital\n    * Nico Brooks, Director of Search Technology, Atlas\n    * Clay Bavor, Product Manager, Ads Quality, GoogleGord\nLet's kick things off with Anton Konikoff from Acronym MediaAnton\nAd testing is more than a one dimensional activity. Will go into when, where and how to test ads. Anton looks at the world through keywords \u2013 \"keyword driven marketing\"Keyword Driven Marketing\n- Equates a keyword with the customer\n- Focus on the language the customer uses to decipher the meaning and target the messaging accordingly.\n- Important to keep customer voice and intent in mind when testing.\n- Equally important for B-B and B-C\nWhy Do Ad Testing\n- Gain insights in a controlled environment \u2013 quantifiable results.\n- Help understand the effectiveness of the messaging\n- Identify the appropriate products/offerings\nKey Metrics\n- CTR \u2013 but as a process metric and a final metric\n- Conversion Rate by Ad \u2013 this is the ultimate measure of success\nSetting Up Ad Testing\n- How many ads should you test?\n-- Whatever you're comfortable with really. (though he says some may disagree)\n- Sample Size\n-- How much data\n--- 100 clicks might be enough but 1000 is certainly better \u2013 it depends on the campaign.\nAd Copy Testing\n- Test Headlines and Display URLs\n- Keep your headline consistent and test the description. Then move back to test headline.\n- Test the call to action \u2013 is it price point?Pull out the best performer of description test and then test headline.\"The Click Through Rate is Irrelevant\" \u2013 gets in trouble for this view, but has seen low CTR generate high conversion rates.More Granular Tests\n- Punctuation\n- Capitalization\n- Proper Case vs. Sentence Case\n- Accent Usage\n- Keyword Insertion\nSirius Radio Case Study\n- Tested $30 rebate vs. One Month Free \n- Period: 1 month\n- $30 rebate conversion 3.5%, free month 1.5%\nCommon Pitfalls\n- High CTR may be bad\n-- Is the traffic qualified\n- Too many variables?\n-- Be sure you know which change made an impact\nGoogle Image Ad Testing\n- Tested 3 TV commercials on Google site targeting network &amp; Quigo Video beta test\n- 3 different ads, different actors and slightly different messaging. Initial screen was the same.\n- CTR was consistent \u2013 but weren't only testing for that.\n- Metrics\n-- How far did the customers watch\n-- What was the CTR\n- Findings\n-- Winner 60% completion and 30% higher CTR using simple split test.\nPath to Success\n- Start with the most simple/straightforward test\n-- Apply more variable over time\n- Be brave and bold in testing radical hypothesis. Challenge the status quo.\n- Set aside a budget only for testing\n- Set up a testing process that is ongoing and consistent. Find the right mix of elements and continue to push testing. \n- Always test something!\n- Don't settle for current results. Improvement is always possible through structured testing.Nico Brooks\nLet's talk about suggestions for doing ad testing, how to measure performance and share an idea about the research. Plus going to share a little bit of dataSuggestions\n- Separate branded and non-branded keywords\n- Look at history of the ad clicks/interaction that lead to a conversion \u2013\n-- Don't just look at the last click.\nDefining route knowledge \u2013 it's how we think about where things are. Know where something is (like a business) without really knowing the exact physical location.Big Idea\n- Much of search activity if motivated by route knowledge.\n- Analogy \u2013 Ants and Compost Bucket\n-- Ant problem at commune. So long as the bucket was moved, the ants would not get to it.\n-- The ants used route knowledge to find the bucket and when it moved, the ants couldn't find it.\n- How we think about where something is has to do with how we get there.Applying to search data\n- Users remember how they got there before. They may not remember the URL, but they know how they got there. So they go the same way hoping to get the same result.Search Study\n- Segmented 275k clicks between first visit and reports as well as branded vs. non-branded\nResults\t\n- Repeat visits were nearly % of total clicks.\n- Brand data was more than 50% of clicks\n- Repeat and Branded was nearly 1/3 of all clicks.\n- Repeat plus branded accounted for nearly 70% of clicks\nSuggestions\n- #1\n-- Separate branded and non-branded keywords\n-- Branded keywords aid navigation and boost interest\n-- Non-branded keywords create interest \u2013 which is good from a customer acquisition perspective.\n- #2\n-- Navigation clicks may be masking the true value driven by other keywords and ad types.Jontahan Mendes\nIt doesn't have to be scary or overly quantitative.  Start simple and small then get more advanced. Great tools \u2013 some free, some not so free. You can also do it without a tool, just using a spreadsheet.Keys to Successful Testing\n- Always have a single question to answer.\n-- The best test will answer that question and ask many more.\n- Have a large differentiation between elements that you are testing.\n-- Draw out the differences\n- Temporal Behavior\n-- Results during the week may be different than those over the weekend\n- Collect enough data to reduce margin of error and increase confidence.\n-- Too little data may induce false positive.\n- Segment results \n- Act! Take action on results and keep on testing.\nWhy Test\n- Testing is better than guessing.\n- We test because despite how smart we are we can learn.\n- Don't Guess!Ad copy testing itself can yield a significant change in conversion.Why do ads work?\n- Impression upon the user\n- Interest Ads generate interest in the product/service\n- Expectation that you will find what you want\n- Persuasion \u2013 our goal is to sell the product/serviceTest Ads by Match Type\n- Created redundant ad groups and test against one another by match type.\n- Understand, test and measure the impact on your campaigns.\nBrand Keywords \u2013 waste of money?\n- Tested 1 week on 1 week off\n- No seasonality.\n- Ad went to homepage\n- Single version of the ad\n- 30 branded keywords\nDid they drive traffic? NO.\nDid having the ads increase conversion? YES \u2013 up to 32%\nHaving the ads was a huge win.Case Study - Best ads to increase conversion?\n- Took 4 elements and 3 variations and dropped it into an array for testing.\n- Design was 9 tagged ads (URL tagging)\n- Tagged landing page &amp; thank you page.\n- Ad optimizer was turned off.\nResults\n- Some ads really tanked. Some lift and one gave 36% conversion lift.\n- Gave a window into each factor that had something to do with success.\n- Description line was found to be the winner \u2013 but beware because it varies from test to test.\nBake Off\n- Winning recipe versus predicted recipe\n- Final winner gave a 52% lift for the clientGord\nWas going to talk about a Google research project \u2013 brand, non-brand \u2013 top versus side sponsored. 8am today came the realization that the presentation would have been about how people respond to different parts of the real estate, but he decided to toss the presentation.Instead he is breaking the box and looking at the new testing box.What's Next?\n- Search results page has been pretty static the last several years. We are introducing many new variables to testing so a heads up is probably better.\n- Pace of change on the SERP is going to increase.\n- On the cusp of search experience changesStrive to maintain balance between ads and organic result relevance. Need to raise the bar on ads to provide a richer experience. Value of images, video in addition to text. Leads us to better targeting \u2013 the keyword \u2013 knowing more about the customer through personalization.If the natural results get better \u2013 will users stop clicking ads?When an image is introduced on a page, users in eye tracking study used the image to divide the page. Users looked at result immediately adjacent to the image. Scanning ran down from the image (in slot 3-4) which is different from what is seen in non-image based search results.Ask users are learning how to navigate the more complex page and are doing it quickly. This will impact advertising.Tested a personalized search page. Using various groups of data, paid and organic results. Also used personalization to identify the user. Displayed products, stock and stores that carry your favorite product.Results: Users oriented themselves to the organic and top sponsored listings. Note \u2013 the interface was a surprise. \n- Interaction with the page was pretty typical with about 8 seconds.\n- Page had a left side bias\n- Sponsored locations \u2013 top sponsored did well, other 2 did almost nothing\n- Time Spent on page \u2013 Organic results got lions share however, shop local section was pleasant surprise.\nWrapping Up\n- Cannot count on same linear scanning activity \u2013 which has driven testing historically.\n- As images appear we \"berry pick\"\n- Richer ad choices and personalization will drive the experience.\n- Lines will become blurred between organic and sponsored listings.\n- Information scent and top left relevance are going to continue to be dominant behaviors.Clay Bavor\nSpend time providing perspective on how Google views ad testing and campaign optimization. Plus talk about a tool that was recently released.- Goal is to show relevant ads, making sure the user experience is good.\n- In the long run, a good user experience is good for everyone.\nHow to make the user experience very good?\n- Ad testing will drive the best user experience\n- 2 things to do\n-- Step back and look at keywords. Are they conceptually grouped?\n--- The more targeted t\n-- Don't drop the ball on the landing page. Take some time and make sure they correspond to the ad text and keywords that are driving traffic there.\n-- \n- Think of ad testing as putting yourself in the user's shoes to drive high quality traffic.\nCheck out \"Search Query Report\" in Adwords.\n- You can find a summary of keywords that are driving traffic which will help you improve the overall performance of campaigns and ad groups\nCircle back to the user experience\n- Target effectively for the user experience your users want\n- Keep the users in mind\n- Test and re-testQ and A\nQ \u2013 Can some shine light on ad with highest CTR is not the ad being served the most?\nA \u2013 Anton \u2013 Idea of ad optimizer is to distribute traffic to the best ads. Other factors are involved \u2013 landing page and other quality factors.\nA \u2013 Google \u2013 Not sure without looking at the specific instance.Q \u2013 Did the eye tracking study, did you track the demographics?\nA \u2013 Gord \u2013 all classified as heavy searchers. Sophisticated searchers.Q \u2013 How can we manage client's historical data if we split out keywords?\nA \u2013 Clay \u2013 It shouldn't be a problem. Google stores account history and is never lost. Keywords and ad test history will be there. Don't be afraid to experiment. Some small churn in quality score, but should adjust pretty quickly.\nA \u2013 Anton \u2013 You should always look at keyword groupings. It's especially important for contextual ads and looking at ad groups for contextual matching.Q \u2013 When I a/b testing ads, they perform better together than either would on its own, can someone explain that? Can you help me think about landing page testing?\nA \u2013 Jonathan \u2013 Look at landing pages, they take some work but looking holistically is the right approach. Test all elements together if you can.\nA \u2013 Anton \u2013 Landing pages are second in testing. Make sure you are following best practices first. Make sure they are targeted and crawlable. Best practices will get you 80% there."^^<http://www.w3.org/2001/XMLSchema#string>
<https://www.seroundtable.com/archives/014561.html>