Research Methodologies

January 3, 2018

Everybody Lies.

Everybody Lies.

Move beyond biases to discover deeper, credible consumer insights.

Editor’s Note: This post is part of our Big Ideas series, a column highlighting the innovative thinking and thought leadership at IIeX events around the world. Tony Costella will be speaking at IIeX Europe (February 19-20 in Amsterdam). If you liked this article, you’ll LOVE IIeX EU. Click here to learn more.

Everybody lies.  All the time.

We lie about sex – how much we’re having, who with and how.

We lie about voting – whether we will or not, and who for.

We lie about brands and products – what we do and will buy and use.

Sometimes these lies are deliberate – social biases meaning we want to project a certain image of ourselves to an interviewer, a moderator or the outside world at large.  Often these lies are unintentional – we can’t accurately recall former behaviour (what beer did I drink 4 weeks ago?), we don’t really understand how we make our decisions (being asked to rationalize future purchase decisions) and often we don’t even know what we truly think or feel about many topics.

As researchers and insights specialists we know this.  We always have done.  We have worked with databases, benchmarks, adjustment factors, rules of thumb – all attempts to ‘correct’ for the biases we know of.  Qualitatively we use extensive projection and elicitation techniques to try to get people to reveal their true feelings.

But it’s not working.  Our industry is at a cross-roads – we are all, client and agency-side alike, somewhere on the spectrum between ‘having credibility issues’ and being a complete laughing stock.  Yet still, the vast majority of the research and insights we work with are straight reporting of claimed ‘facts’.  Still, most of the reports I see (internal and external), and almost all of the initial proposals I receive, are based almost exclusively on single-source research.

Everybody Lies by Seth Stephens-Davidowitz should be compulsory reading for everyone in a research or insights role.  The discerning reader will find plenty of opportunity to pick apart the examples as anecdotal, or confined to narrow areas of relevance.  But that is to completely miss the point.  What Stephens-Davidowitz highlights are new(-ish) and very accessible ways to unearth insight from (often) freely available data.  While the assertion that internet search data is the best, most reliable source of finding the real ‘truth’ is in my eyes a step too far – what the book does an excellent job of is demonstrating that we must look to this source as a credible and valid alternative.

So what actions should we take?

  1. Read the book.  With an open mind.
  2. Build your tool-box.  Become familiar with the new approaches that are available.  See how easy it is to create your own insights.
  3. Resolve to add behavioural dimensions to your proposals and reports.  If you are proposing a new innovation space based on research, demonstrate how search terms around that space are increasing.  If you are writing a proposal for communications tracking, insist on getting access to View to Completion rates across digital channels to compliment or challenge your findings.

Everybody lies.  All the time.  We’ve always known it.  It’s about time we took more initiative to address it directly.

biasbig ideas seriesconsumer behaviordata qualityIIEX

Comments

Comments are moderated to ensure respect towards the author and to prevent spam or self-promotion. Your comment may be edited, rejected, or approved based on these criteria. By commenting, you accept these terms and take responsibility for your contributions.

Tony Costella

Tony Costella

1 article

author bio

Disclaimer

The views, opinions, data, and methodologies expressed above are those of the contributor(s) and do not necessarily reflect or represent the official policies, positions, or beliefs of Greenbook.

ARTICLES

When Easy Becomes Empty: The Frictionless Feedback Fallacy
Research Methodologies

When Easy Becomes Empty: The Frictionless Feedback Fallacy

Making surveys easier doesn’t always improve insights. Discover why thoughtful feedback design balances convenience with meaningful, reflective respon...

Tarik Covington

Tarik Covington

Founder & Chief Strategist at Covariate. Human-Centered Insights

The Always-on Agency: How to Survive the Shift to Intelligence-Native Organizations
Research Methodologies

The Always-on Agency: How to Survive the Shift to Intelligence-Native Organizations

The insight agency model is under pressure. In an always-on world, success depends on becoming a decision partner, not just a supplier of research pro...

Hannah Mann

Hannah Mann

Founding Partner at Day One Strategy

The Ambiguity of Frequent Survey Participation: Is “Hyperactivity” a Signal of Professional Fraud?
Research Methodologies

The Ambiguity of Frequent Survey Participation: Is “Hyperactivity” a Signal of Professional Fraud?

Learn how to identify engaged respondents, detect bad actors, and improve data quality for more reliable research outcomes.

Sebastian Berger

Sebastian Berger

Head of Science ReDem at Rep Data

Ethical by Design: The Questions Every Mixed-Method Research Team Should Be Asking
Research Methodologies

Ethical by Design: The Questions Every Mixed-Method Research Team Should Be Asking

Explore the ethical questions researchers should ask when combining surveys, interviews, AI analysis, synthetic data, and behavioral tracking in mixed...

Ashley Shedlock

Ashley Shedlock

Content Producer at Greenbook

Sign Up for
Updates

Get content that matters, written by top insights industry experts, delivered right to your inbox.

67k+ subscribers