Gartner: What it takes to measure customer experience

Measuring CX is vital, but given the host of measurements out there, it's a complex task. Gartner distinguished analyst shares his thoughts on everything from NPS to customer effort scoring

Measuring CX is vital, but difficult, to do, according to Gartner, as there are hundreds of metrics to choose from and various levels within an organisation to which they should be applied.

This was the message from Ed Thompson, distinguished analyst at Gartner, at the recent Gartner CX Summit in Sydney.

Despite the difficulty of measuring CX and linking it back to financial gain, it can be done if organisations focus on managing down as well as managing up, being inclusive of all parts of an organisation, and proving ROI.

Thompson said measuring CX can be hard to crack, with the most commonly used metrics being Net Promoter Scores (NPS) and Customer satisfaction (CSAT) scores. However, there are new metrics becoming available.

“We see about 25 per cent of organisations using NPS to measure CX. But if we just look at the largest 10,000 companies in the world, it’s at about 75 per cent. CSAT tends to be used the most often,” Thompson said.

“However, if you track CSAT over time, most companies move less than 2 per cent in a decade. You can improve it, but it’s hard, and those with the lowest scores over time tend to cease trading altogether. Also, companies with strong branding tend to do very well with CSAT scores.”

With regards to NPS, the downsides can be achieving consistency across questions and collection of data, Thompson continued. Drawing conclusions about causation is also difficult, as is closing the loop, getting buy in from executives, and proving a financial link of NPS.

Strengths of NPS meanwhile include higher response rates, strong executive understanding of the metric, and its industry and cross-company benchmarkability.

“There have been a few innovations around NPS, where people are tweaking it. There is the Customer Effort Score by CEB, which claims to be a better predictor of revenue growth and profitability than NPS, but more for customer service orientated organisations. Often NPS and CES are used together, with NPS as the output, and CES used to actually affect change within the organisation. This trend is growing,” Thompson explained.

“There’s the Word of Mouth Index by ForeSee, I quite like this one. This says NPS overstates detractors for the biggest brands by 780 per cent, because just because someone is not a promoter doesn’t mean they are a detractor. It is a slightly more nuanced approach.

“Or there’s the Brand Advocacy Index from the Boston Consulting Group. This make a distinction between unprompted vs prompted recommendations, and claims a strong correlation between it and top line growth.”

Thompson went on to explain emotion analysis is now being used in the top 2-3 per cent of organisations.

Read more: Choosing the right CX metric

But regardless of which metric is used, Thompson said a key mistake being made is picking a metric and driving it right through the organisation when many don’t understand it.

“We would argue for a hierarchy of metrics relevant to individuals in different levels of organisations. We see a lot of organisations trying to shortcut this by not systematically working out what level of metrics they should put into each level of the organisation," he said. "As long as it’s transparent and people can see how they can affect it, then they are interested. But if you can’t see how to affect it, you get a lot of dissatisfaction from employees,” he explained.

Thompson reiterated the correlation between employee satisfaction and customer satisfaction and how most organisations aren’t being inclusive enough when it comes to CX metrics.

“If we ask who measures CX, we get customer service people or marketing departments, and maybe HR in some companies. The thing that’s missing is process improvement, product engineering, R&D, operations, and manufacturing. The bottom line is, the core quality of the product or service impacts the CX. What are you doing in the core product or service in terms of quality?

“We must cut across boundaries and hunt down core quality or service metrics. The bottom line is quality teams are usually the ones being missed out on this. IT is also another key part that gets missed, as does supply chain. All these things impact the CX.”

The next difficulty around measuring CX, is demonstrating ROI, because it’s an indirect cost centre benefit that can take years to realise.

“You can measure ROI on CX, it’s hard and takes time and effort. Those organisations that do measure it, simply have people who measure it on the job - it takes resourcing,” Thompson said.

“The biggest problem is it’s usually last on the list in terms of costs. It’s an indirect benefit, as there’s a time lag payback. Organisations have to have patience - the biggest payback is usually four years out. That’s a big challenge.”

Key recommendations from Gartner:

1. Avoid using only one top-level CX metric. Short-term improvements to the single top metric rely on improvements in multiple lower-level CX metrics.

2. Work with the strengths of NPS and try to minimise the downsides, particularly improve staff understanding of how they can influence the measure.

3. Watch metrics across the whole organisation, not just one or two, and identify how each metric is calculated, who tracks it, and who is accountable for the improvement.

4. Create a hierarchy of CX metrics.

5. Don’t ignore the most neglected categories, such as quality and employee engagement.

6. Move to emotional metrics if relevant.

7. Prove your ROI.

Follow CMO on Twitter: @CMOAustralia, take part in the CMO conversation on LinkedIn: CMO ANZ, join us on Facebook: https://www.facebook.com/CMOAustralia, or check us out on Google+:google.com/+CmoAu 

Join the newsletter!

Or

Sign up to gain exclusive access to email subscriptions, event invitations, competitions, giveaways, and much more.

Membership is free, and your security and privacy remain protected. View our privacy policy before signing up.

Error: Please check your email address.
Show Comments

Latest Videos

Conversations over a cuppa with CMO: The Star's George Hughes

It's been an incredibly tough three months for the Star as it shut its doors and stood down staff in response to the COVID-19 lockdown. Yet innovation has shone through, and if the CMO, George Hughes, has anything to say about it, such lateral thinking will continue as we start to recover from the crisis.

More Videos

We would like to invite you to the Virtual Exhibition about IoT Trends in 2020, 7 - 9 July, organised by Must.We developed a new B2B matc...

hayfa

Want to master digital transformation? Stop thinking about your own problems

Read more

We have been trying to help our clients through this time. I think the important thing is clear communication! We also created some check...

Erin Payne

Is COVID-19 the right time for a positive marketing campaign?

Read more

Very good article Sagar. Congrats! It's exactly what we are doing at Dafiti and it's very important have you close to us into this journey.

Roosevelt Junior

Making Your Organisation Data-Driven [MYOD] - Data-driven marketing - CMO Australia

Read more

Corporates should be innovating to stay relevant and disrupt the market and collaborating with startups is easily the best way to go for ...

Diana

How your company can innovate its way through the COVID-19 crisis

Read more

Very welll written Sagar and gives an excellent overview for data strategy for an orgaanization!

Ritvik Dhupkar

Making Your Organisation Data-Driven [MYOD] - Data-driven marketing - CMO Australia

Read more

Blog Posts

Business quiet? Now is the time to review your owned assets

For businesses and advertiser categories currently experiencing a slowdown in consumer activity, now is the optimal time to get started on projects that have been of high importance, but low urgency.

Olia Krivtchoun

CX discipline leader, Spark Foundry

Bottoms up: Lockdown lessons for an inverted marketing world

The effects of the coronavirus slammed the brakes on retail sales in pubs, clubs and restaurants. Fever-Tree’s Australia GM Andy Gaunt explains what they have learnt from some tricky months of trading

Andy Gaunt

General manager, Fever-Tree Australia and New Zealand

Younger demos thought lost are now found: But what about the missing money?

There is much talk about what VOZ will bring to the media industry. New ways to slice and dice audiences and segments. A clearer understanding of screen consumption. Even new ways to plan and buy. The most interesting result could be finding something many thought we lost - younger viewers, specifically the valuable 18-39s.

Michael Stanford

Head of 10 Imagine and national creative director, Network 10

Sign in