Showing posts with label consumer research. Show all posts
Showing posts with label consumer research. Show all posts

Friday, February 05, 2010

The customer satisfaction prison: When one becomes a five

I am not a number: I am a free man!
-The Prisoner

Back in the late 60's, British Television aired a series called The Prisoner. In it, a British Intelligence officer abruptly resigns, and finds himself kidnapped and held prisoner in an isolated, seaside location where he is known only as...Number 6.


He finds himself amongst hundreds of other nameless but numbered individuals living tranquilly in a surreal Orwellian resort village. The perpetually sunny space is outfitted with the dark shadows of surveillance, hypnosis, and mind control schemes, administered by a series of nameless Number 2's who want to know, on behalf of an unseen Number 1, but one thing: Why did he resign?

I bring this up as a loose link to a new number 1 in the quest to quantify customer satisfaction: Number 5.

Number 5 being the number expected when asked to rate our satisfaction with whatever customer experience we've had. It goes something generically like this:

'Hi, On a scale of 1 to 5, with 5 being completely satisfied, how would you rate the service you just received?'

The Likert-ization of customers serves a valuable data capture and analysis purpose. I've worked with clients using five-point thinking to:


  • identify directional trends in collective pools of product feature and attribute feedback; 
  • gather a point of objective reference in a world of subjective customer service nuance; 
  • and occasionally, to provide actionable insight on pricing, promotion or positioning.


But, like the seemingly tranquil village in The Prisoner, a look below the surface of 5-point customer satisfaction surveys sometimes reveals a dark undercurrent: when the Number 5 becomes an end unto itself, we risk transforming people into numbers.

Turning constructive feedback into an unsatisfying feedback experience

Here's a story. I recently had my car serviced. I was handed a two-page survey to complete when I left. I set it aside...in the recycling pile.



Five days later the phone rang and, soon regretting my decision to answer the Toll Free number, I spent 5 minutes answering ten questions from a polite corporate representative about my local dealer service experience.

In the course of asking me 10 questions, I rated one area a 4, rather than a 5. I also mentioned that my service rep was helpful and professional. End of story. I had provided honest feedback on my mostly excellent experience. Or so I thought.

A day later, I got a call from my local dealer service rep. He seemed a bit nervous. My 'not 5' rating on 1 of the 10 questions the day before had already made it back to him. He implied that he needed 5's, even though the 4 I provided was in an area beyond his direct responsibility (scheduling).

It was very personal to him: Because, as I found out, his job performance was evaluated based on whether his customers all give all 5's.

He mentioned that the same corporate entity that called me, would be sending me a more detailed survey via the email address on file and hoped that if there was anything he could do to get all 5's he sure hoped I would tell him.

I spent 5 minutes on the phone telling him what I told the corporate surveyor. When I got the email survey it said it would take about 10-15 minutes to complete. Right.

So what?

The story I relay above is meant to illustrate, in real terms, how good intentions in seeking completely satisfied customers sometimes go awry. To borrow a phrase, let me be clear: I believe in research and I believe in customer survey data. The modern world is built, afterall, on that which can be quantified. But it's also built by that which, perhaps, ought not be quantified quite so easily.

Quantifying one's perceptions, for instance, doesn't magically make them anyone else's.


As marketers, we understand that a good customer experience can be undone pretty easily and a bad one can be hard to overcome. So why let the otherwise useful act of satisfaction surveys be a risk to the very satisfaction they survey?

Four principles for putting quality in the quantity

Here are four general principles--derived from being both purveyors and party to hundreds of customer survey initiatives--that I believe will help create a good feedback experience:

1. Align time + value: Ensure that the time requirement you ask of the customer is only a small fraction of the time invested in the actual experience being surveyed. In other words, a survey on a 2-minute transaction should probably take far less than 2 minutes. Likewise, align what you invest in measurement with the value of the customer.

2. Identify what's being evaluated: If you are asking about an overall experience, state that and mean it...and be comfortable with the limits of generalized conclusions. If you are asking about a specific aspect of the experience, then clearly state that. Knowing what you are asking requires a clear understanding of your satisfaction survey objectives. In other words, why ask? Broad based questions seldom result in specific feedback. Using general responses to draw specific conclusions is risky. Likewise, using specific feedback to draw generalizable satisfaction conclusions can easily eliminate any relationship between effect and cause.

3. Use data first to learn, then to confirm: Learning often comes from failure. If the point of a customer satisfaction survey is to confirm what you already believe or hope is true, save everyone their time and let it be true because the organization believes it is. If the point is to learn, then something that is not a '5' should be embraced as an opportunity to do good.

4. Keep it personal: Behind the numbers are real people...customers and associates...who defy descriptions in 5 shades of gray. Incorporating some facility for open-ended response helps keep people present in the analysis.  

Customer satisfaction surveys need not create a prison of numbers. Applying a few reasonable considerations helps ensure that people are Number 1 in the customer satisfaction show.

Tuesday, October 28, 2008

Satisfy consumers for the next decade

James L. McQuivey, PhD
VicePresident, Principal Analyst

  • The adoption curve (the hockey stick!)...70% of people are connected by...wait for it...household electrification rates from the 1930s. So all the technology adoption curves behave according to an adoption curve that looks like a hockey stick.
  • How can we use this to forecast consumer behavior? 
  • Why do some people adopt technology sooner than others? [Enough question, we want answers!]
  • The answer: eventually, obtaining technology becomes convenient enough. 
  • Put another way, when the technology becomes convenient enough, it is rapidly adopted. 
  • Point: people share a set of universal needs...satisfy these needs with convenience and you will win. [the challenge is idenitfying the need, not the device]
  • What do people really need? How can you give it to them? What should you do to be ready? That's the agenda for this.
  • What are universal human needs? [Well, Maslow is a start]...but he thinks Maslow was wrong in a particular way: they are not ordered...they are messy [and this is where we get to the individual, right? your order is not my order]

Here's the Forrester view of 4 universal needs:
  • Connection--being connected to something bigger than ourselves [why politics and religion work for so many]
  • Uniqueness--we are special [the individual!]
  • Comfort--[hope?]
  • Variety--[play and learning?]
  • So what?: Everybody has all four...they just vary by individual. [of course the variety embedded in the term variety is, well, quite variable].
  • Our needs shift over time, and we'll tradeoff our needs against themselves [ourselves?]...we'll trade comfort for variety for example.
  • [haha...fictional tradeoff in choosing between a PC and a Mac..against the four types of needs].

How do you give people what they need [against these needs]?
  • You win with convenience. It is a means of access to their needs..it is not a need unto itself.
  • Convenience = All the benefits of you product/service minus all the barriers of it
  • Digital camera example: $1669 sony 1Megapixel camera in 1998...digital print service online in 2003...17 models with 5 megapixels for under $100 at Walmart in 2008...Digital Camera penetration at >70% in 2008. [Convenience driven by the cheap revolution]
What do you need to do to succeed?
  • Know your customer's target need profile [there's an average, but you have to leave room for variation or this is little more than another attempt to define prism-like clusters!]
  • Know and increase your convenience quotient [and of course Forrester offers reearch to define the quotient for you]...the quotient is a single score between -1 and 1...it expresses the benefits - the barriers. [obviously useful for establishing directional baselines versus competitiors and alternative approaches from the same organization...can R+K establish a convenience quotient for our service offerings? Perhaps a meaningful approach to evaluating innovation at the agency?]
  • Examples in customer service application of the cQ like evaluating FAQs, sending an email and calling an 800 number.
Summary, Audience Questions and Random Thoughts
  • People share a set of universal needs--satisfy them with convenience and you will win.
  • [Diane and I think it would be an interesting exercise to apply a Convenience Quotient exercise against some of our clients brands]
  • Forrester shooting for a 12 question approach to identifying the four needs.
  • A fair amount of qualitative/subjective data applied to the profile.
  • Do you think needs analysis will carry across cultures? We have confidence these needs are universal. 
  • [the challenge is of course that defining these needs with specificity is where we are different].
  • [Convenience is not the same as simplistic...if you enjoy complexity, convenience is not about simplifying things that are part of the complicated need...hiding the data associated with training for a marathon is not the same as providing convenient access to it and the tools to manipulate it...spreadsheet software, web applications are examples?].


Monday, September 22, 2008

Research goes responsible

The conversation is changing...rapidly. From obsession with tech to depression over oil...the consumer is talking in terms of social responsibility, global 'issues' moreso than 'opportunities'..and of course the economy.

Someone once said that the stock market didn't cause the Great Depression, the societal depression caused the stock market crash.  Research firm Yankelovich is picking up on the riff that economic anxiety is rapidly moving up for that homgenous tribe known as 'The Consumer". 

Their latest research report, to be released tomorrow, indicates that high anxiety is on the rise. In fact the trend is so pronounced, that Yankelovich is updating all their research through the lens of consumer anxiety.  Some fndings about consumer expectations:

  • Cheaper does not equate to lesser...
  • Expectation for customer service is increasing, arguably out of a sense that the provider of service 'should be grateful for my business'. 
  • Unwilling to lower expectations sets us up for a crossroads.

IF people have learned to assume they are in control, what happens when the economy makes it harder to service that expectation? This is the new responsibility marketplace.

In this marketplace, which is in the process of emerging, the consumer empowerment movement of hte last decade+ becomes a means rather than an end goal. What is the goal? This is individual. It's about:

  • Making touch choices.
  • Pragmatism and practicality
  • Ownership of our challenges.
What is the reaction of the 'iConsumer' to th e realities of economic limits? The research does not see victimization among consumers, despite some of the headlines.

AN interesting finding is that, for those who have severe economic anxiety, the need for 'new' increases...can we assume that thrill seeking behavior will be sought out? Perhpas alcohol and tobacco? It seems we've been here before, but thats a tough call to extrapolate to each of us as 'the consumer'.

Overall, there is also a need for 'real' and 'pure'. People are saying its hard to find trustworthy information (61% asked). We all think we are better than everyone else at things, including idenitfying what's 'truth'. 

Listening to Yankelovich's report, it sounds indeed like the country is depressed. We'll know soon enough whether the chicken or the egg calls the shots. Either way societal acrimony looks to be part of the journey ahead.