And why it’s super hard to measure
And it really is an essential component of demand gen. Essential.
Let me digress for just a bit.
Assume you’re zeroed-in on your category, your demand gen is solid and scaled, and now you’re creating a steady, growing stream of prospects to your sales team. And they’re closing them at a brisk pace.
As hard as all that was, now the real work begins. That solution to the problem you promised the prospect? It now needs to be delivered through the product experience. The very first time that new user signs on.
I wrote about this in my blog post on conversion optimization of demand generation. That new customer found your product because of how it was marketed to them. The very first time a new customer experiences the product, it has to align with the value proposition your promised. So, how do you know if you’re delivering on that promise?
It’s super hard.
And it’s super important, because customer acquisition is pointless without retention. Jamie Quint explains this exceptionally well in a guest post on Andrew Chen’s blog, and goes further to highlight that retention is the core driver of virality. That means retention is a core driver of your…demand gen. Right. Full circle.
First of all, you need to look at each user in the context of a group of users called a “cohort” – usually this starts as the collection of users whose first experience with your product happened during the same timeframe (day or week typically). And you can see how the cohort segments into usage activity patterns – some will be super active, some moderately active, and some not active at all.
This can get you started, but doesn’t really tell you a whole lot. You really need to know two other “hard to define” metrics.
First – what constitutes a meaningful action for that user in their first session? That means you don’t just need to understand the core functionality of your product, but how that first time user is going to interact with that functionality to get something they consider valuable done. This is exactly where your product team and your marketing team should have a happy collision.
Didn’t your marketing start the acquisition process by trying to figure out what the exact words that prospect would use to describe their problem? At the very beginning of the customer journey? Well, now the product team needs to deliver the solution in the form of an experience, in terms that the converted prospect (now customer) will recognize as valuable. To them. Of course it’s not that simple (buyers may not be users, but buyers did buy solutions to problems your marketing team zeroed in on).
Second – how frequently will that customer be expected to use your product? You need to know this to establish the baseline of your entire measurement approach. Is it hourly? Daily? Weekly? You may think you know when you’re developing the product, but product design is focused on personas and assumptions about usage. Now you’ll need to check those assumptions through cohort-based analysis of real world people. Amplitude has a great blog post about figuring out how often people use your product.
And everything I just described is virtually impossible to measure with Google Analytics. That free tool is awesome for measuring website activity, but is architecturally incapable of measuring cohorts (believe me, my teams have tried, hard and GA is miserable at cohort analysis). There are some really exciting companies filling that void who have designed cohort-based tools specifically for behavioral product analysis. Amplitude is one – who offers a free versions that you can use to instrument your product and get plenty of data, and then of course have much more sophisticated capabilities you pay for.
Finally, retention is made up of “activating” a customer – making sure they have not just a successful first experience, but that they have a second successful experience and then ensuring long term customer “adoption.”
This is where Product owes an obligation to Customer Success to ensure that customers activate, and then the success team can drive long term adoption. So the product team should own understanding what value needs to be delivered in the first two uses of the product. This will take intensive focus on data, cohort behavior, and many, many iterations with the product design and dev teams. Customer Success should be a part of this process because they will need to take those two experiences and ensure they become hundreds or thousands, or more.
What’s worked well is to have a weekly meeting with Product, Product Design, Development, and Customer Success, where the product manager leads the analysis of usage, and the resulting product and resource development to ensure successful activation. You can think of this as a smooth handoff of customer accountability:
In my last role the company had gotten to scale without any focus on product usage or product usage measurement. I was fortunate to have a whip-smart product manager who spent an entire year of these weekly meetings getting grounded in the basics, and bringing that cross functional team to have a clear and compelling understanding of what drove the first two experiences.
And bringing this back to where I started. Product activation is a critical step in your demand gen strategy. It’s why a lot of CMOs have responsibility for both product and marketing, and if not, it’s why CMOs need to have super tight and trusted relationships with their product colleague.
Tags: amplitude, cohort analysis, google analytics, product activation
Open Ambition 
Leave a comment