CX platform scorecard
Most people buying their first CX platform do not know what to ask. Pick what you want your tool to do. We will give you the questions, and you tick off any tool you are evaluating. Free, and no email needed.
Step 1
Pick the level you want to reach. Each level includes the ones before it.
Pick a level on the left. This panel will show what your tool should do for you, and the questions below will open up.
to have a score you can trust, and to watch it over time.
It should reach your customers, ask them what you want to ask, and give you a number that still means the same thing next year.
That is the whole job at this level. It is a real job. It also does not need a CX platform. A normal survey tool like SurveyMonkey is built for exactly this. If this is as far as you want to go, buying more than this means paying for things you will never open.
to know what is going wrong, where, and what to fix first.
It should read every comment your customers wrote and sort them the way your business is sorted. It should tell you which problems move your score, let you cut that by branch, product or region, and hand you a list of what to work on in order.
This is where a survey tool stops being enough. The work is no longer collecting answers. It is working out what they mean.
to let the people who deal with customers act on this themselves, without waiting for a central team.
It should do two things, and they are usually sold as two separate products.
First, someone who is not an analyst should be able to ask a question in plain words and get a real answer. Second, when a customer has a bad experience, it should reach the person who can help, with a clock on it, and the conversation should happen and be written down.
Analysis on its own gives you reports that nobody acts on. A case queue on its own fixes customers one at a time, and never tells you what keeps breaking.
to connect this to money, and to know what a good experience is worth.
It should stop reporting your score and start telling you what a customer's experience at one point did to what they did next.
Take one point in your customer journey. Did the customers who rated it well come back more often than the ones who rated it badly? Did more of them renew, or buy again? Those are questions about money, and a tool at this level answers them by counting.
For that it needs a record of what each customer went through, and a way to count what they did next. You also need a person. Someone has to turn a count into a target, and a target into a business case your finance director will sign off. No software does that part on its own.
Step 2
Tick yes or no for each question. Answer for whichever tool you are evaluating. We do not score anyone here, including ourselves.
These questions belong to levels above the one you picked. They are here so you can see what you have chosen not to need. They do not count towards your result.
Some of your customers read email. Many do not. If your tool can only send email, your score only tells you about the people who read email. Look for email, SMS and WhatsApp. Also look for a link that can be opened during a phone call, one per customer, if you still call people.
You will want to change a question, add a language, or skip a question for some people. Check whether you can do that yourself. If every change is a request to the vendor, you will stop making changes.
Your first draft is never right. You will rewrite questions. Ask what happens to your trend when you do. Some tools tie your history to the exact words of the question, so changing a word starts a new line and your old data no longer joins up. Ask about the open comment box too, not just the score.
Scores like NPS and effort scores have a set way of being worked out. It is not an average. A tool that averages a 0 to 10 question is giving you a number you cannot compare to anything, including your own last quarter. Also ask if the method stays fixed once you pick it.
If you run three surveys, one person can get all three. That is the fastest way to kill your response rate. Look for a limit on how often one customer can be contacted, counted across all your surveys and not just one.
Ask your own security team first. Many banks and insurers say no. If yours does, you need a tool that keeps names, phone numbers and account numbers on your own servers. It swaps them for codes before anything is sent out, and only turns them back into real names inside your own network.
Tick yes if the tool can do that, or if your security team is happy for the data to leave. Check this now. Otherwise you can get all the way to signing and then be stopped.
These questions belong to levels above the one you picked. They are here so you can see what you have chosen not to need. They do not count towards your result.
Thousands of comments are useless as a pile. You want them sorted into your own groups, with big groups broken into smaller ones. Check whether you build those groups or whether the tool ships a fixed list. No two companies have the same problems, so a fixed list will not fit yours.
It will get some wrong. What matters is what happens next. Look for a way to check a batch, fix the mistakes, and have the tool learn from your fixes. If you cannot correct it, you will not trust it, and if you do not trust it you will not use it.
"The app crashed and then nobody answered the phone" is two problems in one sentence. If the tool files it under one heading, you lose half of it. This has a side effect worth knowing: your category percentages will add up to more than 100. That is correct, and a good tool will not hide it.
Same trap as 1.3, one level down. You will reorganise your categories as you learn. Ask whether the trend for a category survives that.
You want a list of what to fix first. Two things decide if that order is real. First, ask whether the things on the list have passed a test, or are just the ones that came out highest. Second, ask whether it counts people or counts answers. One customer who picks three problems is one person, not three, and tools that get this wrong will overstate whatever gets picked alongside other things.
If the answer to "which branches?" is a spreadsheet someone has to prepare, the analysis gets done once, by one person, and then never again.
Small groups produce wild results. A good tool hides a chart when too few people are behind it, rather than drawing it anyway. Ask what its limit is and whether you can see it.
Boards ask for target versus actual. Some tools build every chart only from survey answers, so there is nowhere to attach a target line or a range you set yourself. If your board pack needs this, find out before you buy, not after.
These questions belong to levels above the one you picked. They are here so you can see what you have chosen not to need. They do not count towards your result.
Your branch managers will not learn a reporting tool. They should be able to type a plain question and get an answer. Check that the answer shows its working: from the score, down to the causes, down to the actual comments customers wrote. An answer you cannot trace back is a guess with a nice font.
Giving decisions to more people means giving data to more people. You need to control who sees what, create your own roles, and connect it to the sign-in system you already use. Without this, your risk team will stop the rollout.
Two ways to solve this, and either one counts as a yes.
If you took the route in 1.6, the details never reach the tool at all, and you are done.
If they do reach the tool, you should be able to mark a field as personal with a switch, then choose which roles can see it. A service rep working a case may need the customer's name. Everyone else does not. Check that this applies to downloads as well as screens. Hiding a name on screen and then letting anyone export it is not hiding it.
Ask whether an alert fires on one customer's answer, on its own, straight away. Some tools collect them up and send them overnight. By the morning, the customer has already told somebody else.
A low score is the obvious trigger. It is not the only one. Look for the ability to set different limits for different customers or regions, to fire on certain words in a comment whatever the score was, and to fire on the tone of a comment. A score-only rule misses the customer who gives you an 8 and then describes something serious.
The case should land with the branch, the dealer or the region it came from, worked out from the data itself. If everything lands in one central queue, somebody has to read and forward all of it, and that job is what kills these programmes.
You should be able to build your own steps, as many as you need. Two, five, twenty. Each one marked as open or closed. Some needing a note before anyone can move on. Some locked so a case cannot be passed to someone else.
Here is why it matters. A useful default separates "waiting on us" from "waiting on the customer." Most systems roll those into one. When they are rolled into one, a case sitting for four days because your team has not touched it looks exactly like a case sitting for four days because the customer has not replied. Only one of those is your fault, and you cannot see which.
This is the one people forget to ask. You want to say: if a case has been open three days, tell the manager. If it is still sitting in one step after a week, tell their boss. Look for a way to build those rules yourself, choosing the wait, the condition and who gets told. If it can only be set up by the vendor, every change is a support ticket.
Due dates. A flag when something is late. Live counts of what is open and what is overdue. And a time-stamped record of every change, every handover and every contact. If you cannot show it, you did not close the loop. You discussed it.
Adding a note, sending an email, logging a call, attaching a file, sending a follow-up survey, changing how the case is filed. Every jump to another piece of software is a place the work stops.
In some markets you must have permission before contacting someone about their feedback. The place to ask for it is the survey. If the customer says no, no case should be created.
This is a survey design choice, made before you launch, not something you sort out later. It also means fewer customers can be contacted than complained, which changes how many staff you need. Rules differ by market, so take your own advice on what applies to you.
These questions belong to levels above the one you picked. They are here so you can see what you have chosen not to need. They do not count towards your result.
Every step that customer met, on one line, in the order it happened. With their opinion attached at the steps where they answered a survey, and nothing invented at the steps where they did not.
Ask what this costs to set up. It should need no new data feed and no integration work, because the event that says a customer came back is the same event that sends them their next survey. You are already sending it.
This is the money question. You want a number that says: customers who rated this well came back more often than customers who rated it badly.
Then ask how that number is made. If it is a count of what your own customers actually did, you can put it in front of your finance director. If it is a model, you will spend the meeting defending the model instead of the finding.
Four things to check about that number. Each is its own yes or no.
Four sub-questions follow. Each one is its own yes or no, and each one counts.
The sensible wait after a test drive is not the sensible wait after a repair. If the tool uses one fixed period for everything, it was not built for your business.
You should not have to add a question, or start using a metric you do not use, to get this. It should work off whatever you already ask at that point.
This number needs a decent number of customers on both sides. Ask what the limit is, and whether it is checked on each group separately or on the survey as a whole. A tool that answers anyway will hand you a very impressive number built on eleven people.
The two groups of customers differ in more than how they rated you. No method like this holds everything else steady. A tool that says more likely to is telling you the truth. One that says drives or causes is handing you a claim you will have to defend.
Your big yearly or half-yearly score arrives too late to do anything about. The useful trick is to connect the small surveys you run all the time to that big score, so the small ones warn you early.
Two things to check. The delay between them should be measured from your own data, not guessed. And ask honestly how far ahead it can see. It can only reach as far as the shortest delay in the chain, because after that the early warnings have not happened yet.
At this level you need more than a screen. You need someone who can look at your data, work out why one group of customers comes back and another does not, and help you set a target you can defend.
A target should come from your own data and from how hard your problem actually is to fix. Not from a benchmark, and not from a rule about how far a score can move in a year. Ask who does this work, whether they are included, and what they have done before.
Your result
Nothing ticked yet.
Pick a level above, then answer the questions. Your result updates as you go.
Take this list to your next vendor call. Ask about each one, and ask what they would do instead.
Nothing here yet. Any question you answer no to will be listed here.
Take this list to any vendor. Including this one.
Numr makes a CX platform called CXM. If you want to put these same questions to us, we will answer them one at a time.
Talk to us| No level chosen yet | 0 of 0 answered | —% |
What you want: to have a score you can trust, and to watch it over time.
It should reach your customers, ask them what you want to ask, and give you a number that still means the same thing next year.
That is the whole job at this level. It is a real job. It also does not need a CX platform. A normal survey tool like SurveyMonkey is built for exactly this. If this is as far as you want to go, buying more than this means paying for things you will never open.
6 questions in total.
What you want: to know what is going wrong, where, and what to fix first.
It should read every comment your customers wrote and sort them the way your business is sorted. It should tell you which problems move your score, let you cut that by branch, product or region, and hand you a list of what to work on in order.
This is where a survey tool stops being enough. The work is no longer collecting answers. It is working out what they mean.
Includes everything in Level 1. 14 questions in total.
What you want: to let the people who deal with customers act on this themselves, without waiting for a central team.
It should do two things, and they are usually sold as two separate products.
First, someone who is not an analyst should be able to ask a question in plain words and get a real answer. Second, when a customer has a bad experience, it should reach the person who can help, with a clock on it, and the conversation should happen and be written down.
Analysis on its own gives you reports that nobody acts on. A case queue on its own fixes customers one at a time, and never tells you what keeps breaking.
Includes everything in Levels 1 and 2. 25 questions in total.
What you want: to connect this to money, and to know what a good experience is worth.
It should stop reporting your score and start telling you what a customer's experience at one point did to what they did next.
Take one point in your customer journey. Did the customers who rated it well come back more often than the ones who rated it badly? Did more of them renew, or buy again? Those are questions about money, and a tool at this level answers them by counting.
For that it needs a record of what each customer went through, and a way to count what they did next. You also need a person. Someone has to turn a count into a target, and a target into a business case your finance director will sign off. No software does that part on its own.
Includes everything in Levels 1, 2 and 3. 33 questions in total.
| Level | Questions | Yes | Score |
|---|---|---|---|
| Level 1 — Measure | |||
| Level 2 — Diagnose | |||
| Level 3 — Act | |||
| Level 4 — Impact |
| Ref | Question | Answer |
|---|---|---|
| 1.1 | Can I reach my customers where they actually are? | Not answered |
| 1.2 | Can I write and change the survey myself? | Not answered |
| 1.3 | If I improve my questionnaire, do I keep my history? | Not answered |
| 1.4 | Is my score worked out the right way? | Not answered |
| 1.5 | Will it stop me pestering the same customer? | Not answered |
| 1.6 | If our data is not allowed to leave the building, can this still work? | Not answered |
| 2.1 | Can I read everything my customers wrote, grouped the way my business works? | Not answered |
| 2.2 | Can I correct it when it sorts a comment wrongly? | Not answered |
| 2.3 | Can it cope with a customer who complains about two things at once? | Not answered |
| 2.4 | If I change my categories, do I keep that history too? | Not answered |
| 2.5 | When it tells me what matters most, can I trust the order? | Not answered |
| 2.6 | Can I see which branch, which product, which region — without asking for an export? | Not answered |
| 2.7 | Will it stop me making a decision on ten answers? | Not answered |
| 2.8 | Can I put my own target on the chart? | Not answered |
| 3.1 | Can someone who is not an analyst just ask a question? | Not answered |
| 3.2 | Can I let a manager see their own results and nothing else? | Not answered |
| 3.3 | Can I hide my customers' personal details from most of my staff? | Not answered |
| 3.4 | Do I hear about a bad experience within minutes? | Not answered |
| 3.5 | Can I decide what counts as a problem worth chasing? | Not answered |
| 3.6 | Does it go straight to the person who can help? | Not answered |
| 3.7 | Can I set up the steps a case moves through, to match how we work? | Not answered |
| 3.8 | Can I build my own chasing and escalation rules? | Not answered |
| 3.9 | Can I prove we actually closed the loop? | Not answered |
| 3.10 | Can my team do the work without leaving the screen? | Not answered |
| 3.11 | Can I ask the customer's permission inside the survey itself? | Not answered |
| 4.1 | Can I see everything one customer went through, in order? | Not answered |
| 4.2 | Can it tell me whether a good experience at this point is worth anything? | Not answered |
| 4.2.1 | Can I choose how long to wait before counting? | Not answered |
| 4.2.2 | Does it work with the question I already ask? | Not answered |
| 4.2.3 | Will it refuse to answer when there are too few people? | Not answered |
| 4.2.4 | Does it say "more likely to" rather than "causes"? | Not answered |
| 4.3 | Can I see my yearly score coming before it arrives? | Not answered |
| 4.4 | Is there a person who will help me turn this into a target and a business case? | Not answered |
Take this list to your next vendor call. Ask about each one, and ask what they would do instead.
| Ref | Question |
|---|---|
| 1.1 | Can I reach my customers where they actually are? |
| 1.2 | Can I write and change the survey myself? |
| 1.3 | If I improve my questionnaire, do I keep my history? |
| 1.4 | Is my score worked out the right way? |
| 1.5 | Will it stop me pestering the same customer? |
| 1.6 | If our data is not allowed to leave the building, can this still work? |
| 2.1 | Can I read everything my customers wrote, grouped the way my business works? |
| 2.2 | Can I correct it when it sorts a comment wrongly? |
| 2.3 | Can it cope with a customer who complains about two things at once? |
| 2.4 | If I change my categories, do I keep that history too? |
| 2.5 | When it tells me what matters most, can I trust the order? |
| 2.6 | Can I see which branch, which product, which region — without asking for an export? |
| 2.7 | Will it stop me making a decision on ten answers? |
| 2.8 | Can I put my own target on the chart? |
| 3.1 | Can someone who is not an analyst just ask a question? |
| 3.2 | Can I let a manager see their own results and nothing else? |
| 3.3 | Can I hide my customers' personal details from most of my staff? |
| 3.4 | Do I hear about a bad experience within minutes? |
| 3.5 | Can I decide what counts as a problem worth chasing? |
| 3.6 | Does it go straight to the person who can help? |
| 3.7 | Can I set up the steps a case moves through, to match how we work? |
| 3.8 | Can I build my own chasing and escalation rules? |
| 3.9 | Can I prove we actually closed the loop? |
| 3.10 | Can my team do the work without leaving the screen? |
| 3.11 | Can I ask the customer's permission inside the survey itself? |
| 4.1 | Can I see everything one customer went through, in order? |
| 4.2 | Can it tell me whether a good experience at this point is worth anything? |
| 4.2.1 | Can I choose how long to wait before counting? |
| 4.2.2 | Does it work with the question I already ask? |
| 4.2.3 | Will it refuse to answer when there are too few people? |
| 4.2.4 | Does it say "more likely to" rather than "causes"? |
| 4.3 | Can I see my yearly score coming before it arrives? |
| 4.4 | Is there a person who will help me turn this into a target and a business case? |
Levels stack. Picking a level turns on its own questions and every question from the levels before it.
What you want: to have a score you can trust, and to watch it over time.
It should reach your customers, ask them what you want to ask, and give you a number that still means the same thing next year.
That is the whole job at this level. It is a real job. It also does not need a CX platform. A normal survey tool like SurveyMonkey is built for exactly this. If this is as far as you want to go, buying more than this means paying for things you will never open.
6 questions in total.
What you want: to know what is going wrong, where, and what to fix first.
It should read every comment your customers wrote and sort them the way your business is sorted. It should tell you which problems move your score, let you cut that by branch, product or region, and hand you a list of what to work on in order.
This is where a survey tool stops being enough. The work is no longer collecting answers. It is working out what they mean.
Includes everything in Level 1. 14 questions in total.
What you want: to let the people who deal with customers act on this themselves, without waiting for a central team.
It should do two things, and they are usually sold as two separate products.
First, someone who is not an analyst should be able to ask a question in plain words and get a real answer. Second, when a customer has a bad experience, it should reach the person who can help, with a clock on it, and the conversation should happen and be written down.
Analysis on its own gives you reports that nobody acts on. A case queue on its own fixes customers one at a time, and never tells you what keeps breaking.
Includes everything in Levels 1 and 2. 25 questions in total.
What you want: to connect this to money, and to know what a good experience is worth.
It should stop reporting your score and start telling you what a customer's experience at one point did to what they did next.
Take one point in your customer journey. Did the customers who rated it well come back more often than the ones who rated it badly? Did more of them renew, or buy again? Those are questions about money, and a tool at this level answers them by counting.
For that it needs a record of what each customer went through, and a way to count what they did next. You also need a person. Someone has to turn a count into a target, and a target into a business case your finance director will sign off. No software does that part on its own.
Includes everything in Levels 1, 2 and 3. 33 questions in total.