Research Methodologies

January 16, 2017

The Solution for Polling Accuracy: Less Logic, More Xenophobia!

The recent US election landed a crushing blow to the research industry’s credibility. So what’s to be done?

The Solution for Polling Accuracy: Less Logic, More Xenophobia!

So, it’s happened again. After the British general election in 2015 and the Brexit referendum, now comes the latest blow to the reputation of the polling industry with Trump’s ‘unexpected’ win in the US presidential race. And, as ever, the opprobrium has already started, with the world seemingly placing the blame at the feet of those pesky pollsters. “Ohhhh, they got it wrong again!”, “Can’t they do anything right?!”.

It’s enough to make me wish I’d chosen a different career; one where I could quietly do a slapdash job, safe in the knowledge that when my and my colleagues’ failings came to light, nobody would care, nor suggest that they know better than us. Something like working in a telephone help centre; being a quality control checker on German diesel cars; or a rocket scientist. Around SpaceX’s latest rocket pre-takeoff explosion, there seemed to be quite a lack of people asking really, what are they all doing, it’s not that hard.

But after this latest crushing blow to the research industry’s credibility, and assuming that people are right – that observing the polling figures differently would have changed the result of the election – what’s the problem?

Well, there’s a clear trend of unconscious observer bias. A recent WSJ article demonstrated how the same set of polling figures can lead to quite different conclusions, with the specific predicted outcome depending upon the statistical models and personal interpretations applied by a pollster. And unconscious bias plays a large role in this.

Researchers are fairly smart people: educated, with a head for numbers, reasonably articulate, and able to understand the idea of a multi-cultural world. They’re also generally employed, and the industry is becoming, on average, younger and more female over time. But these very attributes are inherently limiting, and shape the way researchers think. Polling firms didn’t predict a vote for Brexit because to any logical person, the idea of the UK seceding from its continent is utterly ridiculous. Likewise, a Trump victory wasn’t widely predicted because the idea of a xenophobic bigot winning the most important job in the world through a popular vote is unfathomable – at least to logical, educated, reasonably articulate people who can understand the idea of a multi-cultural world.

So what’s to be done? Fortunately, the answer is clear and, indeed, easy. In order to break out of this limited mindset, and become better at predicting elections and referenda, research firms need to have greater diversity in their ranks. Forget women and ethnic minorities (those are so last year): the research industry needs to be employing more angry, old white people; those who didn’t finish school; men who like to grab women by the unmentionables; those who don’t like to talk through their problems, but instead want to rage at how the system is fixed. Most importantly, perhaps, we need to do better at hiring people who think that foreigners are to blame for everything, and for whom a weird mix of national isolationism and imperialism provides the ideal solution to all the world’s problems. Only then can polling firms break away from the tyranny of the logical approach, and start to better understand and more accurately predict the views of the electorate.

Nick Drew is VP, Strategy & Insights at Fresh Intelligence. The views above are his own and not intended to be taken seriously.

 

Photo by Steve Houghton-Burnett on Unsplash

biaspollingquantitative researchsample

Comments

Comments are moderated to ensure respect towards the author and to prevent spam or self-promotion. Your comment may be edited, rejected, or approved based on these criteria. By commenting, you accept these terms and take responsibility for your contributions.

Nick Drew

Nick Drew

2 articles

author bio

Disclaimer

The views, opinions, data, and methodologies expressed above are those of the contributor(s) and do not necessarily reflect or represent the official policies, positions, or beliefs of Greenbook.

More from Nick Drew

Searching for Meaning – The Future of Research
Research Methodologies

Searching for Meaning – The Future of Research

The discrepancy between clients’ worries and vendors’ concerns is an issue when considering the future of the industry

ARTICLES

How to Choose Between Qualitative and Quantitative Testing for Your Research Project
Research Methodologies

How to Choose Between Qualitative and Quantitative Testing for Your Research Project

Learn when to use qualitative vs quantitative research and how modern insights teams combine both for smarter decisions.

Ashley Shedlock

Ashley Shedlock

Content Producer, Editorial & Search Optimization at Greenbook

Back to the Roots: Why Panel Design Matters More than Ever
Research Methodologies

Back to the Roots: Why Panel Design Matters More than Ever

Jennifer Reid argues that strong panel design and persistent identity improve fraud detection and drive more meaningful, trustworthy insights.

Jennifer Reid

Jennifer Reid

Co-CEO and Chief Methodologist at Rival Group

Beyond Churn: A Practical Guide to Learning Customer Retention Research
Research Methodologies

Beyond Churn: A Practical Guide to Learning Customer Retention Research

Discover how to learn retention research using CX, analytics, and AI tools to reduce churn and build loyalty.

Ashley Shedlock

Ashley Shedlock

Content Producer, Editorial & Search Optimization at Greenbook

The Insights Industry Has a Decision Problem — And It’s Costing Companies Millions
Research Methodologies

Partner Content

The Insights Industry Has a Decision Problem — And It’s Costing Companies Millions

Companies don’t lack insights, they lack activation. Discover why valuable research goes unused and how real-time intelligence drives better decisions...

Evan Williams

Evan Williams

Executive Strategy Consultant at Stravito AB

Sign Up for
Updates

Get content that matters, written by top insights industry experts, delivered right to your inbox.

67k+ subscribers