Lots of product managers shy away from customer feedback. They think it takes too much time and effort to gather, and that if they did everything people said they want, the result would be a bloated product that fails because it’s trying to be everything for everyone.
Their wariness isn’t totally misplaced. Feature creep is a real problem PMs have to avoid. But at the end of the day, the product determines what kind of experience the customer has. If that experience isn’t up to snuff, the PM has failed, and the product will fail too.
That means PMs are walking a fine line. They need to understand the voice of the customer (VOC), but they also need to separate the wheat from the chaff and pinpoint the feedback that will actually improve the product.
Net promoter score (NPS) is the weapon of choice here. It gets right to the heart of whether or not customers (you know, the folks who write you the checks) are successful with your product. While some criticize NPS data as overly simplistic, that simplicity actually makes it easy to analyze feedback from huge samples of users and figure out what product changes will have the biggest impact on customer experience. Let’s dive more into why NPS is so valuable to PMs and how they can get the most out of it.
PMs have a million different metrics to look at. Daily active users, free trial conversion rate, churn—the list goes on and on. When they hear NPS, they probably think it’s something for marketing or customer success to worry about.
On the face of it, the question NPS asks—“What’s the likelihood you would recommend this product to a friend or colleague?”—does sound more tied to customer satisfaction or word of mouth marketing than it does to product.
But think about the deeper meaning behind that question. It’s really asking customers, “Does this product solve a problem for you, and do you think it could for others?” That’s the entire reason customers buy software products in the first place. If they’re not likely to recommend you, they’re saying that they don’t think your product creates enough value to justify buying it. Getting the “why” behind each customer’s NPS rating lets PMs pinpoint what changes to the product could create more of that value.
Intercom has built an entire business around enabling companies to communicate directly with customers. So, it’s no surprise that customer feedback is a core internal value in addition to a key part of their product offering.
Naturally, that applies to their product team as well. Every week, Intercom’s PMs read through hundreds of conversations between users and customer success to find ways to improve. It might strike you as a menial, annoying task, but Intercom’s PMs know that reading this feedback is the only way to understand how their product can provide more value to customers.
The entire system depends on the customer success team diligently tagging every conversation they have with the topic the customer wanted addressed: usability, feature request, bug, whatever. PMs then analyze the tags to create “hit lists” of common problems to focus on.
image source: Intercom
You can use NPS to create a similar taxonomy of user issues by collecting and analyzing each customer’s reasoning behind their NPS rating. Make sure you’re targeting customers who have had enough time to use your product and form an opinion, and then:
That process lets you tie every single NPS response back to specific parts of your product and see what each respondent needs in order to get more value.
Should you just start trying to solve everything customers complain about indiscriminately? Of course not. That would lead to the bloated product you want to avoid in the first place, not to mention drive you completely insane.
That’s why it’s not enough to just tag each verbatim and count up which issues get the most attention. You need to dig into the data and figure out what’s worth addressing based not only on how many customer verbatims mentioned each issue, but also what kind of customers mentioned them—promoters, detractors, or passives.
Think about it. If someone complains about your UI but would readily recommend your product, then improved UI isn’t that big a deal. It’s more of a nice-to-have. Complaints from detractors, however, point to issues that are causing more damage to the customer experience.
Atlassian’s PMs are huge proponents of using NPS to guide how they build and improve products over time. Once they’ve read through all the verbatims and linked each one to specific categories, they have a simple framework for using that data to focus on where the product actually needs to improve.
The key takeaway: While the sheer number of customers who complain about an issue is important, the Atlassian PMs prioritize the issues cited disproportionately by detractors. Those problems are having a bigger effect on customer experience, so the PMs can have a bigger impact by fixing them.
That’s why they create a table of every issue that emerged in NPS responses, how many respondents complained about it, and most importantly, the average NPS scores of the users who referenced each category:
image source: Atlassian
At first glance, you might think performance is the big priority because more customers griped about it than anything else. But the NPS data shows that most of those customers are happy enough with Atlassian to recommend it. The problems with tables and usability, however, attract a lot of complaints and come from less happy customers. Fixing those issues would be the best way to improve the overall customer experience.
As the Atlassian process illustrates, NPS lets PMs separate the product changes that might be “nice to have” from the ones that would drastically increase value for currently dissatisfied customers.
Customers buy tech products because they have a specific objective they want to achieve or problem to solve. That’s the foundation of the all-important product-market fit every company needs to succeed. Yet the people in charge of those products spend most of their time cut off from customers. PMs don’t have time to be out on the front lines every day like customer success, but to get the most out of NPS data, they need to talk to respondents to understand exactly what they’re looking for.
Once you’ve sorted the data and identified the general areas where the product needs to improve, you need to find the customers with interesting responses and figure out the context of their complaints and requests. What value are they not getting from your product, and what changes could provide that value?
Allianz isn’t a tech company, it’s an insurance provider. But its customer service agents have mastered a crucial customer success strategy known as closing the loop. Closing the loop means speaking directly with customers who have lodged complaints, learning how the organization can better meet their needs, and translating that into strategy.
image source: Bain
For example, several Allianz health insurance clients complained on NPS surveys about delayed claim reimbursements. But when customer service spoke to them, they talked more about not knowing the status of their claims. The problem was more the lack of communication than speed. So Allianz created a system to immediately call or text customers to explain any delays. The department’s NPS scores shot up. Loop closed.
Here’s how you can apply that exact strategy as a PM:
Your users are probably the only people who spend as much time with this product as you, and whether they get value from it is the difference between success and failure. Talking to them is the best way to ensure you’re delivering what they need.
Entrepreneur-turned-VC Mark Suster writes here about a failed attempt to add a to-do list feature to his construction collaboration software, BuildOnline. The feature gave users a beautiful process to input tasks, assign them, and choose a due date, but since the team lead never talked to his architect and contractor customers, he overlooked a core need of theirs: They needed to input dozens of tasks at once, which would take ages under his process. The feature was useless.
There’s an important lesson in there for PMs. You can build the greatest product in the world, but it doesn’t mean anything if it doesn’t improve the reality your customers are living in.
Nothing uncovers that reality better than NPS. It cuts through the noise, lets you understand where your product falls short for customers, and gives you the data you need to fill the gap.
There’s no shortage of content about UI/UX, and the discipline itself is fast-moving. Whatever your primary interest—whether it’s accessibility, front-end design or user research—there’s a UX blog for you. So, how can you know which of blogs or news sources are worth exploring? Not to fear, we’ve done our own research and think that these … Continued
This post was written by Qualaroo team member Sarah Cantu. Have you ever tried to remember a close friend’s favorite type of sweet treat for their birthday or celebration, only to realize you have no idea what flavors they prefer? In fact, you’ve probably eaten sweets with this person on more than one occasion, only … Continued
The Net Promoter Score (NPS) has historically been the single key indicator of success for customer service teams across most industries.
At Qualaroo, we believe that user feedback is at the heart of the success of all businesses. Our mission is to make user research faster, easier, and more accessible for companies of all shapes and sizes.
When it comes to methods of gathering feedback, the gold standard for marketers is the in-person focus group. This format offers an opportunity to gather opinions, verbal feedback, and observation of attitudes about your product. However, focus groups can also be costly and time-consuming, which can be prohibitive for small teams or small budgets. But this shouldn’t hold you back from gathering high-quality feedback.
At Qualaroo, we know that user feedback should be integral to your UX and digital product strategy. After all, your product, sales, and marketing teams are not mind readers. User feedback contextualizes what your users want and eliminates the guesswork of product development.
How can you know what someone thinks when they aren’t vocalizing their thoughts or feelings? How do you solve problems for users who aren’t providing you with raw feedback (or any feedback for that matter)? This is a consistent challenge UX and marketing professionals face. Without a written response, reaction or review, it can be difficult to know how to improve your product and its user experience.
Over the past few months, we’ve made a number of updates to Qualaroo designed to make your experience better: like revamping our Sentiment Analysis and NPS reporting experiences. Today we’re excited to announce another such release: Qualaroo now supports Content Delivery Network (CDN)!
Like any field, there are ideas and best practices in web design and experience that have become central tenets. While these “laws” are meant to improve web usability and experience, they’re certainly not immutable.
In November, we released a set of new reporting functionality in Qualaroo’s reporting dashboard. Complete with improved NPS reporting, nudge performance statistics at a glance, and word clouds, we brought you new ways to get more out of your Qualaroo experience.