Research Methodologies

January 31, 2022

3 min read

Five Key Principles to Improve Data Quality

Five Key Principles to Improve Data Quality

Helping market researchers prevent fraud and improve data quality.

Given contemporary growing concerns about the topic in the market research industry, it’s no surprise that data quality is by far the most important factor when choosing a market research partner or supplier (GRIT Report 2020).  Broadly considering the presentation of survey fraud and poor quality data, here are five key principles wise to apply to any quantitative market research study:

 

 1. Fraud evolves over time

The quality assurance (QA) checks that worked well in the past to prevent fraudulent survey responses are no longer sufficient.  As panels continue to improve their frontend tools to block fraud, fraudsters also become more sophisticated in their ability to get into our surveys. Evolving past the fraudsters, and developing the right tools and strategies to stop them, is a continuous and critical effort.

 

2. There is no silver bullet

Alas, there is no single, one-stop solution for detecting and preventing fraud. Instead, we approach the problem by thinking of it in terms of layers of protection that are implemented throughout the research process from design to analysis. Panel sourcing, fraud detection software, programming logic built into the survey, and backend checks work seamlessly to prevent different types of quality issues.

 

3. Automation alone is not going to solve data quality issues

Today, there is a fair amount of manual labor involved in identifying suspicious patterns in data. While technology easily spots outliers, human intelligence is still essential in designing robust questionnaires, deciding how to measure fraud, setting appropriate thresholds for suspicious respondents, and identifying systematic issues that are far more obvious to humans than they are to algorithms.

 

 4. Human error is not fraud

People make mistakes, get frustrated, or misread a question, but none of those things invalidates an entire survey. In fact, being reminded that real humans are taking your survey can be reassuring. Systematic fraud, both organized and malicious, is harder to identify and has a much bigger impact on the data.

 

5. Everyone has a role to play

Related

Online Sample Has A Good Problem and a Very Bad One - Data Quality

Everyone involved in the research process has a role to play, starting with the panel providers who ultimately decide who is allowed into our surveys. That said, researchers are best-positioned to assess data quality as they typically know what to expect from the results.

 

These five key, self-imposed principles keep us researchers on our toes and serve to focus our efforts on the most effective ways to prevent fraud and improve data quality. By acknowledging data quality challenges and striving to keep abreast of issues in the field and new tools and strategies in the industry, we can uphold the data quality standards we hold ourselves to.

Comments

Comments are moderated to ensure respect towards the author and to prevent spam or self-promotion. Your comment may be edited, rejected, or approved based on these criteria. By commenting, you accept these terms and take responsibility for your contributions.

Karine Pepin

Karine Pepin

Co-Founder at The Research Heads

16 articles

author bio

Disclaimer

The views, opinions, data, and methodologies expressed above are those of the contributor(s) and do not necessarily reflect or represent the official policies, positions, or beliefs of Greenbook.

More from Karine Pepin

The Neighborhood Never Got Safer, So We Built Bigger Fences
Research Methodologies

The Neighborhood Never Got Safer, So We Built Bigger Fences

Why is market research fighting data fraud one company at a time? Explore the need for industry-wide solutions to protect research quality.

Are We Cleaning Too Much? The Missing Signals in Post-Survey Review
Research Methodologies

Are We Cleaning Too Much? The Missing Signals in Post-Survey Review

How can AI improve survey data cleaning? Learn how richer fieldwork signals can reduce false positives and increase confidence.

Truth To Be Told: Five Realities About Online Sample That Compromise Data Quality
Data Quality, Privacy, and Ethics

Truth To Be Told: Five Realities About Online Sample That Compromise Data Quality

6 min read

Explore five key truths about sampling, uncovering fraud, low-quality respondents, and transparency issues that have eroded data quality over two deca...

From Deliverables to Research Assets: How Insights Teams Can Leverage Content Design Principles for Greater Influence
Research Methodologies

From Deliverables to Research Assets: How Insights Teams Can Leverage Content Design Principles for Greater Influence

5 min read

Learn key principles of content design that enable researchers to distill insights into assets, fostering stakeholder influence and sustainable busine...

ARTICLES

Challenges for Smaller Service-Led Suppliers
Research Methodologies

Challenges for Smaller Service-Led Suppliers

Each firm may have its own formula for success, but pressure to conform may be increasing

Nelson Whipple

Nelson Whipple

GRIT Senior Research Director at Greenbook

The Neighborhood Never Got Safer, So We Built Bigger Fences
Research Methodologies

The Neighborhood Never Got Safer, So We Built Bigger Fences

Why is market research fighting data fraud one company at a time? Explore the need for industry-wide solutions to protect research quality.

Karine Pepin

Karine Pepin

Co-Founder at The Research Heads

How to Choose a Market Research Firm: A Buyer’s Checklist
Research Methodologies

How to Choose a Market Research Firm: A Buyer’s Checklist

Learn what to ask a market research firm, which red flags to watch for, and how to compare proposals before choosing a partner.

Ashley Shedlock

Ashley Shedlock

Content Producer at Greenbook

Only the Attentive Survive
Research Methodologies

Only the Attentive Survive

Two decades of Research Industry Trends Reports continue to help researchers navigate change

Nelson Whipple

Nelson Whipple

GRIT Senior Research Director at Greenbook

Sign Up for
Updates

Get content that matters, written by top insights industry experts, delivered right to your inbox.

67k+ subscribers