Categories
Two decades of Research Industry Trends Reports continue to help researchers navigate change
So far, the 2020s have seen the research, analytics, and insights industry buffeted by change, increasing the difficulty of answering questions like:
Believe it or not, before the outbreak of genAI, before COVID-19, and even before the Great Recession, researchers grappled with these same questions.
We recently came across a 20-year-old industry report that documented these same questions and researchers’ responses to them. The 2006 Research Industry Trends Report, at that point into its fourth year of tracking and not yet the Greenbook Research Industry Trends (GRIT) Report, revealed how the internet was upending traditional data collection modalities and how data quality and availability were threatened. It also explored how these issues might be tilting the balance across in-house data collection and outsourcing, as well as how researcher searches and evaluations of suppliers were evolving.
Although not yet the GRIT Report, this 2006 tome was based on a survey sponsored by Pioneer Marketing Research, Rockhopper Research, DialTek, and “the GreenBook Marketing Research Directory.” As an incentive, respondents were offered a complimentary copy of the 2006 edition of the directory, and 600 people completed the survey. It may seem ironic because the survey would later ask about use of the internet to find suppliers, but paper-based directories were still widely used at the time. In fact, the phase-out of free home delivery of printed White Pages phone directories would not begin for another four years.
The report was signed by Charles L. Montgomery, Ph.D. from Pioneer and Leonard F. Murphy, COO of Rockhopper. Lenny has been the driving force behind the GRIT Report to this day, and currently serves as GRIT’s Executive Editor as well as Chief Advisor for Insights and Development at Greenbook. As Lenny recalls:
When I started the Research Industry Trends project, I had zero budget and zero grand plan — I just wanted to know what this new-fangled internet thing was going to do to the phone-based research business I was earning a living in, so I offered respondents the results just to get them to answer. Lukas at Greenbook liked it, reached out, and the rest is history; eventually it became the Greenbook Research Industry Report.
At the time, the “RIT Report,” as it may have been called, was one of several important industry studies, including reports from MRS/BMRA, Confirmit, ESOMAR, and Honomichl. However, the others mainly concentrated on market size, company rankings, business conditions or specific topics such as technology; this one attempted to take a broader practitioner pulse.
In the early 2000s, the internet was upsetting industry norms much like AI is today, except that the internet delivered connectivity and, ultimately, unprecedented volumes and types of data while AI is shaping entire workflows and redefining roles within them. According to RIT:
As predicted in our 2004 report and confirmed in 2005, the Internet has replaced CATI as the most prevalent quantitative data collection modality across all industry segments.
The internet took the lead as the primary quantitative method among study participants in 2005, but the size of the gap increased by 75% despite a slight drop in the percentage naming the internet. CATI fell even more as “hybrid methods” more than doubled as the preferred approach to quant research.
Although the report doesn’t probe more deeply into the role of hybrid methods, perhaps the industry was looking at ways to leverage the internet in tandem with other methods instead of as a replacement. That would be consistent with the rise of hybrid as a go-to approach while the internet took a supporting role for some.
In some ways, we’ve seen a similar dynamic in recent GRIT Reports. The adoption of faster and cheaper methods does not necessarily mean they usurp established methods. In some cases, the cost and time savings seem to enable insights professionals to invest more strategically in the use of established methods.


The 2006 RIT Report focused on data collection services, so it may not be surprising that more than one-third of participants named declining response rates as a significant challenge facing the industry, easily the most frequently named. Data accuracy/sampling issues was the second-most cited challenge, rising by more than one-third over 2005’s count. These were followed by budget cuts, client issues/Interest in research, and effective use of technology, each of which were well behind data accuracy.
As a US-based survey, however, one of the looming concerns was the impact of new external factors on sample availability and response rates: the spread of Do Not Call lists and anti-spam legislation (CAN-SPAM). These concerns, however, were dismissed by the report’s findings:
We believe researchers are becoming more confident in finding the right tools. Even more people than last year identify declining response rates as the single greatest challenge facing the industry. Fewer, however, felt a need to change methodology as a result – perhaps because they have already done so. This year we’ve seen the continuing rise in online research finally outdistancing CATI, for example. They appear unworried about the impacts of Do Not Call and anti-spam legislation, despite widespread expectation that they would spell big trouble. Rather, declines in respondent rates – a key concern for many – may need to be thought of more broadly: respondents agree that the problem is still a number one concern.
Although barriers imposed from outside the industry did not seem to worry participants in 2006, they are much more impactful in 2026. Various governments have executed and enforced various kinds of privacy rules, and large email providers have implemented practices meant to curb bad actors but also impact legitimate ones.
The 2006 RIT Report devoted considerable attention to the balance between internal and outsourced data collection. It described:
In addition to increasing incentives, researchers are turning to opt-in panels to address declining response rates and sampling concerns. Clients and providers view internal panels as an answer not only to response rate and sampling issues, but to cost and budget constraints as well…
…Forced to rethink the approach to data collection, the industry is building bridges and highways to connect data collectors to survey participants, clients to providers, and ultimately clients to customers. Just as the direct response industry learned to move from a saturation approach to more economical and vastly more effective relationship or database marketing, the research industry is showing signs of moving toward richer and more rewarding interactions among clients, providers, and the public.
Even as the report discussed growing interest in internal panels, outsourcing of quantitative research seemed to inch up while nearly half of client-side participants said they outsourced more than 75% of their qualitative data collection. The report doesn’t show a clear trend across in-house and outsourced work, but it shows the beginnings of a process for understanding it that would inform subsequent research efforts and reports in this developing series.
In each of the four years tracked in the 2006 RIT Report, the top four supplier selection factors were:
In 2006, “good relationship with supplier” was introduced and came in fifth.
In each GRIT Report from the 2020s, the top three selection criteria in every segment are almost always data quality, service levels, and general pricing. These recent surveys do not ask about knowledgeable staff or speed directly, but the four from 2006 line up well with data quality and service levels.
Whereas recent GRIT surveys ask about “general pricing,” the 2006 survey asked about “lowest price,” and it came in next to last, just ahead of “provide data analysis services.” It seems logical that a group that ranks “provides highest data quality” first would not focus much on “lowest price” because they probably don’t coincide very much. They might, however, seriously consider general pricing and overall fairness.
Even though the 2006 study focused on data collection and the later GRIT surveys ask about suppliers and partners in general, it seems like data quality and service level endure as the most important criteria, possibly along with fair pricing. One thing that might be different: given how technology has evolved, the opportunities to provide service - excellent or not – may be vastly reduced compared with 2006.
Although the criteria for choosing suppliers may not have changed much since 2006, the process for finding them has, and it was already changing in 2006.
From 2005 to 2006, the percentage of study participants using online sources to find suppliers edged up slightly to just under 60%. The leading sources were Quirks.com, MRA-Net.org (Bluebook), and Greenbook.org. Despite the fact that GreenBook provided a printed directory as an incentive to participants, mentions of Quirks.com more than doubled those of GreenBook.
Use of search engines to find suppliers was nearly as high as use of online directories, although down from 2005 by about the same amount as use of online directories had grown. Google, however, was named nearly ten times as often as Yahoo! and Overture, plus more than twice as often as Quirks.com. Unfortunately, the 2006 survey did not ask about how successful these resources were in connecting them to suppliers that were a good match.
Of course, the process of finding suppliers is changing before our eyes given the rise of AI search. Although one might imagine AI search to do everything a directory does and more, the reality can fall short of that expectation.
Our own experience with supplier searches over the past year-and-a-half has been less impressive. AI search can omit suppliers we know are present in relevant directories, return surprisingly short lists of familiar names, and offer little visibility into why one company was prioritized over another. Much of the information it finds still originates with suppliers themselves, and it can be difficult to know how current the information is. The supplier has the opportunity to update a directory listing immediately; it has little control over when AI search will reflect changes to their website.
Like AI search, a directory typically depends on supplier-provided information, but it presents it in a curated, structured version compared to what is available “in the wild,” which is likely inconsistently presented and harder to compare across suppliers. Hypothetically, AI search might find unbiased, third-party evaluations of suppliers “in the wild,” but those would have to exist first in order to be found and cited. If truly unbiased evaluations existed, they might even be useful. However, they would need to be representative of the kind of experience you are looking for from a supplier, which is not likely, especially for custom services. Like any other form of discovery, AI search can only find what exists, not what we wish existed.


In the end, a trends report can tell you more about what has happened than it can about what will happen. The first key finding from the 2006 RIT Report was:
As a whole, the results of this Research Industry Trends 2006 Report indicate a positive business outlook for the data collection industry in the year ahead.
That positivity may have been borne out in the year immediately ahead. What nobody filling out the survey could know was what the next two decades would bring: the Great Recession, the explosion of behavioral data and Data Science, COVID-19, and now generative AI. Market research adapted through all of it.
So did the questions the industry asked of itself. But the desire to ask them never abated.
And Lenny Murphy kept pushing to understand where the industry was coming from so he could advise on where it was going and enable others to make their own prognostications. His singular passion for all things market research has helped sustain an unbroken series of Research Industry Trends and GRIT Reports dating back to 2003.
Technologies, methods, business models and even the boundaries of the industry have changed. The underlying idea has endured: ask the people managing, doing, and applying the work what they're seeing, then give the industry the evidence and perspectives to decide what those changes mean. “More than twenty years later, the tools have gone from CATI and web surveys to AI agents, and the questions have gone from 'will the internet replace telephone' to 'will AI replace the researcher,' Lenny says, “but the job hasn't changed one bit: ask the people doing the work what they're actually seeing, and give the industry the evidence to figure out what it means.”
We’ll continue this narrative with the next chapter, the upcoming 2026 GRIT Business & Innovation Report.
Comments
Comments are moderated to ensure respect towards the author and to prevent spam or self-promotion. Your comment may be edited, rejected, or approved based on these criteria. By commenting, you accept these terms and take responsibility for your contributions.
Disclaimer
The views, opinions, data, and methodologies expressed above are those of the contributor(s) and do not necessarily reflect or represent the official policies, positions, or beliefs of Greenbook.
More from Nelson Whipple
Each firm may have its own formula for success, but pressure to conform may be increasing
GRIT looks at insights “ensembles” and how they might be coordinated.
Although Rare Today, the Biggest Spenders Believe Agentic Purchases Will Dominate
4 min read
An exclusive sneak peek into the upcoming Business & Innovation edition of the GRIT Report, previously the Q1-Q2 edition.
ARTICLES
Top in Research Methodologies
Each firm may have its own formula for success, but pressure to conform may be increasing
Why is market research fighting data fraud one company at a time? Explore the need for industry-wide solutions to protect research quality.
Learn what to ask a market research firm, which red flags to watch for, and how to compare proposals before choosing a partner.
What makes an AI flywheel claim credible? Explore the due diligence questions investors, acquirers, and research leaders should ask.
Sign Up for
Updates
Get content that matters, written by top insights industry experts, delivered right to your inbox.