Research Methodologies

January 31, 2018

Are You Still Testing Ads When It’s Too Late?

A blueprint for successful advertising starting with creative design.

Are You Still Testing Ads When It’s Too Late?

Editor’s Note: This post is part of our Big Ideas series, a column highlighting the innovative thinking and thought leadership at IIeX events around the world. Frank Buckler, PhD will be speaking at IIeX Europe (February 19-20 in Amsterdam). If you liked this article, you’ll LOVE IIeX EU. Click here to learn more.

Creativity does not follow rules. Correct. However, if it wants to be successful, it needs clear guide rails – just as the creativity of architects is guided by the laws of statics. But what does actually work – “Celebs?”, “Voice over?”, “Which music?”, “Community or pleasure?”, “Problem or solution?” – there are hundreds of such questions to which research still owes clear answers.

Need for Concrete Guide Rails

75% of the advertising effectiveness does not depend on the budget or the media plan, but on the ‘quality’ of the creation. However, it remains ambiguous what exactly is needed for good advertising. Only 16% of the ad spots are actively recalled and only a third of all creations lead to an attractive ROI.

I recommend to read Byron Sharps “How Brands Grow” to really value the power of evidence-based marketing science.

Objectify Creative Tactics

There are a variety of test methods for advertising. Copy test surveys, eye tracking, EEG measurements, and a lot more. All these methods are good, useful and important.

However, there are two things they fail to do: they just measure the response to advertising, but not the effect of individual design parameters. They collect data which, on their own, do not support any causal inferences. For example, any Coke advertisements will tend to perform better in all parameters – regardless of how good the advertisement is by itself. (I recommend this book on the value of fighting spurious insights “The End of KPI-Illusion”).

The solution we’ll present combines four approaches into one:

  1. The copy test survey, that beside others measures the emotional impact of advertising as well as purchase intention (see this fun website that list the most emotional and effective ads globally).
  2. Re-contacting respondent in order to measure in-market purchases.
  3. The quantitative content analysis: Experts analyze each ad and encode the creative vehicles (celebrity, humor and 90 others) and emotional triggers (indulgence, family love and 130 others).
  4. Determination of the causal contribution to the success of each tactic: Here, self-learning algorithms of artificial intelligence are used to prove what works and what does not. (Looking forward to see Stan’s presentation on this at IIeX)

Eureka Moments

The success factor analysis makes it possible to measure how valid the established “blueprint for successful advertising” is. Compared to the best models to date, this explains 3.1 times better how advertising works. Our multi-client study in 2017 showed that emotions are the key to success. Even rational messages are not processed until emotions are aroused. However, only certain emotions are productive others again extremely destructive.

Furthermore, the study shows that in each product category different basic emotional messages are effective. On top of that, the messages that are usually used in their respective industry are usually not effective – just like the “belonging” message for alcoholic beverages, the “trust” message from financial service providers or the “relief” message for medication.

Also, frequent techniques like celebrities or voice-over generally are not effective. In fact very specific and old tactics are often those, which work wonders. We believe these and dozens of other findings will fundamentally change advertising in the future.

Improve Credibility

Sometimes business partners question market research results. “Purchase intention is not sales” they say. But this gap can be bridged. We can learn from the described approach how to translate purchase intention into sales, under which conditions, at which likelihood. This than makes it possible to attribute generated sales towards creative tactics … and regain credibility.

Want to learn more? Don’t miss Frank’s IIeX Europe presentation CREATIVE.AI: Determining the DNA of Successful Advertising as Well as the Link to In-Market Performance.

advertising researchbig ideas series

Comments

Comments are moderated to ensure respect towards the author and to prevent spam or self-promotion. Your comment may be edited, rejected, or approved based on these criteria. By commenting, you accept these terms and take responsibility for your contributions.

Frank Buckler

Frank Buckler

Founder & CEO at Success Drivers

1 article

author bio

Disclaimer

The views, opinions, data, and methodologies expressed above are those of the contributor(s) and do not necessarily reflect or represent the official policies, positions, or beliefs of Greenbook.

ARTICLES

From Panel to People: Practical Strategies for Building Inclusive and Bias-Free Research in 2026
Research Methodologies

From Panel to People: Practical Strategies for Building Inclusive and Bias-Free Research in 2026

In 2026, research teams move beyond AI adoption. Learn how to build inclusive panels, reduce bias, and deliver more credible, representative insights.

Ryan Walton

Ryan Walton

Entrepreneur at Ryan Walton

How to Improve Collaboration Between Market Research and Product Teams
Research Methodologies

How to Improve Collaboration Between Market Research and Product Teams

Boost product success by aligning research and product teams—test assumptions with real user behavior to plan releases with greater confidence.

Tasbhih Amin

Tasbhih Amin

Marketing Manager at Cirface

The Illusion of Voice: Why Participation Is Not Understanding
Research Methodologies

The Illusion of Voice: Why Participation Is Not Understanding

Feedback systems shape experience. Learn how survey design and dashboards limit what’s sayable—and why participation alone doesn’t ensure real insight...

Tarik Covington

Tarik Covington

Founder & Chief Strategist at Covariate. Human-Centered Insights

Reality Check: Market Research Wasn’t Built for Such a Complex Digital Ecosystem
Research Methodologies

Reality Check: Market Research Wasn’t Built for Such a Complex Digital Ecosystem

Data quality in market research is now a shared responsibility. Learn how prevention, transparency and collaboration can combat adaptive fraud.

Patrick Stokes

Patrick Stokes

CEO & Founder at Rep Data

Sign Up for
Updates

Get content that matters, written by top insights industry experts, delivered right to your inbox.

67k+ subscribers