Originally published in Smart Insights
It’s time to face the facts: focus groups aren’t cutting it anymore. These marketing research relics date back to 1937 when Princeton University researchers investigated what sort of messaging sent over radio airwaves would drum up the most support for the World War II effort.
Focus groups might have been the most viable marketing research option at the time, but there’s no reason researchers should continue to spend $2.2 billion worldwide on the questionable marketing insights offered by modern-day focus groups. Participants may provide a slew of opinions about a product, but that feedback doesn’t predict whether people will actually buy it.
With so many companies mistakenly placing trust in focus groups, it’s no wonder Harvard Business School professor Clayton Christensen reports that 95% of the 30,000 new products created every year ultimately fail.
The consequences of inaccurate assumptions
All of the incredibly meaningful work that goes into the design and prototype of a new product gives marketers a false sense of confidence and security. They feel like they’ve done ample marketing research, collected more than enough data, and modeled that data to build accurate predictive forecasts that they can rely on for a new product launch. In reality, they’re basing critical decisions on misleading assumptions.
In my experience, the most common incorrect assumptions are often based on the recommendations of clients. For example, a company that sold loyalty software through payment providers had multiple clients ask for an app that customers could use to store different loyalty cards. By all accounts, the app solved real-world problems — customers have to carry an excessive number of loyalty cards that are easily lost and forgotten, and those cards bog down an otherwise smooth checkout process.
When the company finally caved to client demand and created the software, it was a massive flop. Clients didn’t purchase it, and customers didn’t download the accompanying app. The moral of the story? The reason for creating and launching a product isn’t necessarily the reason people will buy or use it.
All companies make assumptions, from small startups to large organizations with complex innovation pipelines. While focus groups often reinforce these assumptions, a test-and-learn approach to marketing research is able to demonstrate whether any assumptions about a product, audience, and go-to-market strategy are accurate.
Better insights through a test-and-learn approach
For market validation, it’s important to call out assumptions and design controlled, real-world tests to see if they hold true. Focus groups and other market research can’t provide those nimble, actionable insights.
This is where a test-and-learn approach shines. Through this method, you’ll test highly targeted marketing tactics, messages, and landing experiences against each other in real-time with real consumers. Use a small spend to complete specific tests against your assumptions. The results will show whether your target audience will purchase your product at a price that produces a profit. Let those tests run for a few weeks, and then make adjustments to your campaign as necessary.
A test-and-learn approach can validate all types of physical, digital, software, and service products for both B2B and B2C sales.
A test-and-learn approach can validate all types of physical, digital, software, and service products for both B2B and B2C sales. For example, when we worked with a company launching a new outdoor game targeted at college students, our marketing research defied our original assumptions. We conducted a test-and-learn strategy to find the actual audience for the game. We found that parents — not students — were most likely to purchase the game.
Once we identified the real customer, we researched when and why they bought it, the highest converting channels, and the most effective messaging. We then used these insights to help the company create a successful product launch. Had the manufacturer continued with its original, seemingly safe assumptions, the release of the game could have been a failure.
Test-and-learn in action
A test-and-learn approach can answer all kinds of questions that focus groups gloss over, but here are the four most important insights digital marketers can glean from the process:
1. Customer validation
You’ve probably completed boatloads of customer research, including focus groups before you sat down to design and produce a prototype for a new product launch. People said they would buy the product, so now it’s time to test that. And if they’re buying, you need to determine why.
With a test-and-learn approach, you can set different targets to validate who buys as well as their reasons for purchasing. In almost every test we’ve run, a different or unexpected audience emerges. Importantly, the “why” behind the purchase can change your messaging, marketing channels, and volume projections.
2. Go-to-market channels
The easiest channel to identify and test is the one where you see people buying. However, knowing which marketing channel drives purchases doesn’t answer the why. Why did these individuals change their routine — a possibly stop using a competitor’s product — and start addressing their problems with yours?
It’s likely that you’re making assumptions based on the marketing channel itself. Instead, start with the customers themselves and backtrack along their journey to conversion. When you know why customers are behaving in a certain way, you can take those insights and apply them to many more marketing channels than just your current sales leader.
3. Value proposition messaging
You’ve probably put a ton of time and energy into ensuring that your product solves a critical problem for your target audience, but do you know which message ultimately connects at a level that drives sales?
In focus groups, people generally understood the value proposition and were eager to buy. In a different context, your marketing messaging might not motivate people to take action. Test messaging outside focus groups in real-world scenarios to gain important insights that will drive sales in any number of marketing channels.
4. Revenue projections
You probably can’t assign resources to product development without revenue projections, but those projections should be updated once you gain insights about your customers and the most effective channels of communication.
Use the data you collect against your forecast to influence others in your company. Confidently access the funding you need and set realistic and motivating goals for sales and marketing teams based on facts instead of assumptions.
Assumptions often feel like accurate assessments, which is why they plague the product development cycles of companies around the world. When a new product is proposed and teams are excited about the possibilities, questioning assumptions can feel like raining on a parade. Still, the additional weeks it takes to conduct your due diligence can make all the difference between a failed product launch and a stunning success. Look before you leap with a test-and-learn approach to marketing testing.
Tessa combines her marketing and software product management experience with agile principles to execute Tenlo’s rapid marketing testing, which focuses on identifying and forecasting clients' most effective experiences and sales channels for scaling successful products or launching innovation.
Tessa Burg, VP of UX & Technology Strategy