Article:
Love It or Hate It: The NPS Approach Works
by Brant Cruz, Chadwick Martin Bailey, Inc.
Customer loyalty and your bottom line: Why NPS works.
NPS, or Net Promoter® Score, has generated quite a bit of controversy since its introduction in 2003. And it’s easy to see why. Proponents point to measurement of a single question, the likelihood that a customer will recommend a firm’s product or service, as the key to growing “good profits” and the bottom line. Skeptics dispute this claim, citing a lack of proof; saying that its relative simplicity disguises the more complex issues behind loyalty.
Admittedly, I was one of those skeptics when we began implementing a similar program for all of the reasons others have cited (plus I’ve never met a form of regression I didn’t like). One year later, I’m a strong advocate (a Promoter if you will) of the concepts behind NPS. And I think that this year’s journey has been an eye-opener for me and has added to an already-strong foundation regarding what works, and what doesn’t, when it comes to measuring customer loyalty.
Here are a few of the keys to success around measuring customer loyalty that are hallmarks of Reichheld’s NPS philosophy:
Listen to Your Customer — What THEY Want to Say
No questionnaire, no matter how long and arduous for the respondent, can cover everything. So let your customers tell you what matters, in their own words, then group them into common themes and read every word they say. And when masses of customer comments are read – really read – there is a far better chance of finding inspiration for a solution than when the data provides only higher “attribute” level detail. We’ve learned firsthand about how important this is recently with one of our clients: verbatims picked up an important pain point (and improvement opportunities) related to a business change that would have been completely missed in a more traditional tracking instrument.
Ask Fewer Questions of More People
Keep it short so you can hear from a big sample and broad cross-section of your customers (and prospects). It’s no secret that industry-wide response rates are problematic for a variety of reasons. One thing we can control is the length of our questionnaires, and we know that as interview length goes down, the percent of people who complete goes up. No sampling methodology is perfect and it is still impossible to talk to everyone. But given how hard it is to get someone to pick up the phone or click on a link, don’t we want to ensure that nearly all of them tell us what we need to know?
Link Attitudes to Behavior — Your Transaction Data
Forget asking a ton of behavioral questions – it’s easier than ever for many companies to link individual customer behavior via unique account numbers (e.g., financial accounts, loyalty program membership, unique customer IDs on every eCommerce site) to data collected through a research study. Linking attitudes with behaviors lets you see if how they feel synchs with how they behave – or if how they feel impacts how they behave! Even better, you can create predictive models to find others who “look like” your best Promoters via the data warehouse, and reach out to them to reinforce their (likely) behavior.
So, those are three pretty solid reasons to like NPS. In my opinion, research about them trumps our inborn, researcher need to analyze everything. Flexibility trumps vigilantly tracking exactly the same thing (often, everything) every month. Real behavior trumps self-reported behavior. And meaningfully better response rates trumps just about everything else.
Is the NPS measure materially better than any other single (or multi) measure at predicting behavior than anything else our industry has tried? I have seen several other researchers try to prove that NPS is not a better predictor of behavior than other traditional outcome measures – but all I’ve really seen is that all of this post-survey behavioral analysis is conclusively inconclusive. Given this, I’ll take my chances with a measure that is simultaneously all about the customer and focused on driving and managing an action that we can all agree is good for long-term business success.
In short, I buy Reichheld’s “good profits” argument. But you need more proof, don’t you?
I’ve also seen firsthand the quality of the verbatim responses the advocacy measure elicits. We’ve tested the traditional NPS measure against “likelihood to buy” in a concurrent study and have been able to read and compare more than 12,000 English language verbatims for each. Subjectively, the verbatims based on advocacy are in general more passionate and give better feedback about what is great and what needs work with my client’s brand. More objectively, nearly twice as many advocacy-based verbatims have been coded as “very insightful” (one variable in our rigorous coding scheme is about the “quality” of the verbatim and we have set the bar quite high) – and this translates into nearly 5,000 additional “very insightful” customer comments for our clients executives to read annually.
Despite this ringing endorsement, I do have two suggestions around how to improve upon the original NPS framework that Reichheld proposes and practices:
- Buyer Beware! Invest in due diligence on your company’s “ultimate question.”Despite my strong belief in the power of advocacy, (heck, we’ve been involved in programs to help foster it for 15 years), I strongly advise conducting piloting the NPS metric versus one or more “challengers” and analyzing post survey behavior over several months. I have seen one instance where the traditional question didn’t work (it was negatively correlated with post-survey financial volume) for a certain segment for a client of mine. And we’ve had to test several versions of the question to find the right one. My philosophy is this: in the absence of compelling empirical evidence of a better question, focusing on likelihood to recommend is the best single question to use to measure and manage loyalty. But given the investment required in these large scale trackers – you owe it to your company to make sure the question works in your setting.
- Voluntary Amnesia? Don’t forget everything you’ve already learned! Unlike Reichheld, I recommend that you continue tracking a short (no more than 10) set of previously-identified key drivers in addition to your ultimate question. For most companies, an NPS-like methodology won’t be the first brand or performance tracking research you have ever conducted. You’ve been focusing on some outcome(s) and conducting some form of key driver analysis to determine how to move that/those needle(s). Why stop measuring a short set of attributes that you know matter if you can still keep interview length really short and therefore not materially reduce cooperation rates? While verbatims tell the best and most complete story, by tracking a short set of attribute-level measures you can diagnose some of the reasons for NPS shifts quickly and consistently.
- June 2008
This content was provided by Chadwick Martin Bailey, Inc. Visit their website at www.cmbinfo.com.
Other content shared by Chadwick Martin Bailey, Inc.
Measuring ROI Beyond Traditional Media
by Chadwick Martin Bailey, Inc.
Beyond print and broadcast media: how to effectively measure the impact of sponsorships, experiential marketing and word-of-mouth advocacy. Read Article »
Gear Up, Not Down: Top 5 Keys to Success in a Slow Economy
by Anne Bailey Berman, Chadwick Martin Bailey, Inc.
Five prudent strategy points to consider for your business when the economy has slowed. Read Article »
New Adaptive Choice-Based Conjoint Technique Shows Promise
by Jon Godin, Director of Analytical Services, Chadwick Martin Bailey, Inc.
Adaptive Choice-Based Conjoint is a new conjoint technique that is an approach to discrete choice that would “adapt” to respondent answers as the task progresses. This article provides analysis of the process of this new method. Read Article »
Don’t Give Up On That Segmentation Study – Do It Smarter
by Chadwick Martin Bailey, Inc.
In uncertain economic times, segmentation of your market can be difficult. This article covers top concerns addressing strategists and provides actionable insight. Read Article »
Maximize Your Data
by Chadwick Martin Bailey, Inc.
This article urges you to find multiple uses for your internally generated data through critical thinking and advanced analytics. Chadwick Martin Bailey, Inc. offers examples for applying data in new capacities. Read Article »
The Marketing Performance Advantage
by Rich Schreuer, SVP, Chadwick Martin Bailey, Inc.; CMG Partners
Measuring marketing performance generates interest but is still in its infancy. This survey of 400 companies measured the state of marketing performance, how it is implemented, and its impact. Chadwick Martin Bailey, Inc. shares insights procured from the findings. Read Article »
Taking Your Market Research Demographics off Auto-Pilot
by Cathy Harrison, Senior Project Manager, Chadwick Martin Bailey, Inc.
Recent controversy stirred by the use of an outdated demographic term by the US Census Bureau reminds us to constantly reevaluate our surveys. This article shares tips on keeping your questionaires relevant and accurate. Read Article »
Beyond Excellent Market Research: What Clients Want
by Cathy Harrison, Senior Project Manager, Chadwick Martin Bailey, Inc.
Research providers can make client satisfaction a success with these tips from Chadwick Martin Bailey, Inc. Read Article »
Segmenting the New 'Gamer'
by Chadwick Martin Bailey, Inc.
An interview with Electronic Arts' Stephen Day on their work with Chadwick Martin Bailey in developing a strategy in the gamer marketplace. Read Article »
Measuring What Matters in Super Bowl Ads: The Results
by Jeff McKenna, Senior Consultant, Chadwick Martin Bailey, Inc.
What matters is the results - did Super Bowl ads effectively reach their target demographics? This market research looks at age and income in correlation with ad preferences to try and deduce each company's target audience. Read Article »
Mobile Surveys in Market Research
by Josh Mendelsohn, VP Marketing, Chadwick Martin Bailey, Inc.
This article covers the state of mobile market research as it is today along with practical advice for making mobile surveys work. Read Article »
Qualitative Market Research: 3 Simple Tips for Getting Better Results
by Josh Mendelsohn, VP Marketing, Chadwick Martin Bailey, Inc.
Here are three simple ways to ensure your qualitative projects pay off with truly useful results. Read quotes directly from researchers regarding feedback on the proposal, the report and industry knowledge. Read Article »
Why Brand Tracking Should Include Experiences (incl. Social Media)
by Josh Mendelsohn, VP Marketing, Chadwick Martin Bailey, Inc.
Brand tracking research should cover both the impact of the brand and the impact of experience. This article suggests tracking social media channels as touch points for managing your brand image. Read Article »
Best Practices for Social Media Research
by Chadwick Martin Bailey, Inc.
How do you make sense of all the buzz around social networking sites? This article proposes three best practices for leveraging and measuring communications with your consumers through this medium. Read Article »
Brand Tracking to Help Agencies and Clients
by Chadwick Martin Bailey, Inc.
Brand tracking studies often miss key areas of design and data collection, resulting in poor campaign results. Building effective studies involves individual customization and incorporating external factors that affect data. Develop a successful program with insights from Chadwick Martin Bailey, Inc. Read Article »
A Strategic Compass For Stanley-Bostitch
by Chadwick Martin Bailey, Inc.
This case study involves a brand research project with Stanley-Bostich during economic downturn. Chadwick Martin Bailey, Inc. teamed up to discover insights about their website users, the competitive landscape and how to increase their retail shelf space. Read Article »
Market Research Shows Moving in Together Leads to Clutter
by Kristen Garvey, Director of Communications, Chadwick Martin Bailey, Inc.
Research on consumers finds that a large number of Americans find they have duplicate items when they move in with a significant other. What happens to all these items? This article looks into ways to profit from your household duplicates. Read Article »
Engaging Consumers via Social Media Makes Them More Likely To Buy, Recommend
by Chadwick Martin Bailey, Inc.
New research shows consumers engaged through social media such as Facebook and Twitter are over 50% more likely to buy and recommend than before they were engaged. This study shares both quantitative and qualitative data from a study of 1500 consumers. Read Article »
3 Steps Towards Improving Data and Processes
by Josh Mendelsohn, VP Marketing, Chadwick Martin Bailey, Inc.
One of the top challenges facing marketers is a perceived lack of the right data or processes to make informed key decisions. In addition, there are challenges in using that data for decision-making. This article from Chadwick Martin Bailey, Inc. addresses ways to resolve these issues. Read Article »
Why Measurement Alone Will Not Lead to Better Marketing
by Karl Gustafson; Rich Schreuer, Senior VP, Chadwick Martin Bailey, Inc.
A study of 400 c-level professionals was conducted by Chadwick Martin Bailey to determine how companies are tracking marketing performance. The organizations that measure and manage effectively have common success factors; read this article for practices that will improve your marketing-performance initiatives. Read Article »
Bridging the Gap Between Data and Creativity Through Market Research
by Jeff McKenna, Senior Consultant, Chadwick Martin Bailey, Inc.
The gap between by-the-numbers strategic consultants and creative ad agencies can be bridged by effective market research. In this article Jeff McKenna explains how market segmentation finds consumer preferences, needs and brand attitudes that can help influence the "emotional" and creative side of advertising. Read Article »
Qualitative Research: How the Art of Listening Has Changed
by Josh Mendelsohn, Chadwick Martin Bailey, Inc.
This article takes a look at how qualitative research has changed since the rise of social media and advances in technology. Read Article »
Just Starting Your Holiday Shopping in December? You're Not Alone
by Josh Mendelsohn, Chadwick Martin Bailey, Inc.
This content provides statistics on when consumers start their holiday shopping. If you wait until December, you should know you're not alone! Read Article »
Diet Programs Out, Interactive Fitness Products In
by Chadwick Martin Bailey, Inc.
Adults looking to lose weight have found a new method - interactive fitness products. More Americans plan on using a product such as Wii Fit or EA SPORTS Active rather than using a traditional fitness equipment or diet program. Learn more in this article from Chadwick Martin Bailey, Inc. Read Article »
Why Domino’s new ads are good for the market research industry
by Josh Mendelsohn, Chadwick Martin Bailey, Inc.
The new Domino's ads break down negative conceptions about the research industry. This article describes how the content of Domino's ads are good for the market research industry. Read Article »
Addressing Concerns Over Market Segmentation in Uncertain Times
by Josh Mendelsohn, Chadwick Martin Bailey, Inc.
This article addresses major concerns about conducting segmentation studies in the current economic situation and how to overcome these challenges. Read Article »
A Look At Purchase Decisions: Life Insurance
by Dan Gersten, Chadwick Martin Bailey, Inc.
CMB Research looks at who buys life insurance, for what reasons, and at what point in their life this purchase decision is made. The study of 1500 consumers finds that it's about more than socio-economics and life-stage events. Read Article »
Interview: Avoiding the "Brand Death" Spiral
by Chadwick Martin Bailey, Inc.
When marketing doesn't communicate with operations, the brand image is affected. Rich Schreuer provides an example of customer service not meeting brand image and how this contributes to "the brand death spiral." Read Article »
Market Research Shows IT Service Providers Lack Brand Distinction
by Don Ryan, Chadwick Martin Bailey
IT decision makers around the United States were surveyed about their use of IT-related services. The questions regarding the uniqueness of brands raise concerns about brand distinction in the industry. Read Article »
Using Primary Market Research to Evaluate B2B Social Media Strategies
by Chris Neal, Chadwick Martin Bailey, Inc.
Recent research on social media has found that engaged consumers are more likely to buy and recommend a brand. Chadwick Martin Bailey, Inc. describes this research and their recent work with a leading processor company in re-evaluating their social media effectiveness. Read Article »
Don't Underestimate the Impact of Online Guest Reviews
by Judy Melanson, Chadwick Martin Bailey, Inc.
A recent study asked consumers about social media use and attitudes as it relates to travel, finding an extremely high importance rate on guest reviews. This article shares the impact of positive and negative guest reviews on booking cruises. Read Article »
How Geo-Targeting is Affecting Customer Loyalty Programs
by Josh Mendelsohn, Chadwick Martin Bailey, Inc.
This article shares examples of how companies are engaging customers via mobile, geo-based applications such as Foursquare. Read Article »
Selling Life Insurance to the Under-30 Crowd
by Dan Gersten, Chadwick Martin Bailey, Inc.
Life Insurance: The investment product that protects more than just one's money. This article shares insights from a study of 1,500 U.S. consumers on insurance. Read Article »
Do you care about your customers? Really care?
by Judy Melanson, Chadwick Martin Bailey
If you work for a company like most, a significant portion of your research budget is dedicated to a customer feedback, performance, or satisfaction program. Are you getting the return (in insight) you are making for the investment you’re making? Read Article »
The Facts Marketers Need to Know Before Using QR Codes
by Chadwick Martin Bailey, Inc.
We set out to ask consumers what they think about the 2D bar codes known as Quick Response or QR codes. Here's what stood out, from a marketing perspective. Read Article »
