Feature Prioritization with MaxDiff
Why Product Teams Use MaxDiff for Prioritization
Feature prioritization is MaxDiff's single strongest use case. Product teams typically face a list of 15-30 candidate features competing for engineering time, and they need a data-backed rank order that settles internal debates and aligns the roadmap to what customers actually want.
MaxDiff works for this because it forces trade-offs. A feature survey that asks "How important is Feature X? (1-5)" produces a flat landscape where everything scores 3.5-4.5. MaxDiff forces respondents to choose which feature matters most and which matters least from every set, producing a steep curve with clear winners and losers.
The result is a rank-ordered list where you can say "Feature A is 4x more preferred than Feature B" with statistical confidence. That's a product decision, not an opinion.
Setting Up a Feature Prioritization Study
Step 1: Gather Candidate Features
Pull feature ideas from every source: customer feedback tickets, sales team requests, competitive analysis, internal roadmap brainstorms, and churned customer interviews. Cast a wide net. You'll screen down in the next step.
Step 2: Screen to 15-25 Features
MaxDiff works best with 15-25 items. If you start with 40+ candidates, run a quick internal screen: eliminate duplicates, merge similar items, and remove features that are already committed or already ruled out. The MaxDiff should test features where the priority is genuinely uncertain.
Step 3: Write Feature Descriptions
Each feature needs a 3-8 word description that's immediately understandable to your target respondent. Some guidelines:
| Too Vague | Too Technical | Just Right |
|---|---|---|
| Better reporting | Implement GraphQL resolvers for report queries | Custom report builder |
| Improved UX | Reduce time-to-interactive by 40% | Faster page load times |
| Security stuff | OAuth 2.0 PKCE flow implementation | Single sign-on (SSO) |
The description should communicate what the user gets, not how the engineering team builds it. Test your descriptions with 3-5 people from your target audience before finalizing.
Step 4: Configure the MaxDiff
Standard configuration for feature prioritization:
- Items per set: 4 (occasionally 5 for lists above 20 items)
- Number of sets: 12-15 (each item appears at least 3 times)
- Task wording: "Which feature is most important to you? Which is least important?"
- Survey placement: After 2-3 context-setting questions, before demographics
Step 5: Target the Right Respondents
Feature preferences vary dramatically by user segment. Survey the people whose priorities should shape your roadmap:
- Current users for retention-driven features
- Trial users who didn't convert for acquisition-driven features
- Churned customers for features that would have kept them
- Prospects for features that would attract new customers
Mix your sample intentionally. An all-current-user sample will prioritize incremental improvements. An all-prospect sample will prioritize table-stakes features you might already have.
Plan for 200-300 respondents total, or 200+ per segment if you need segment-level comparisons. See the sample size guide for details.
Reading the Results
The Priority Stack
Your output is a ranked list of features with ratio-scaled scores. A typical product-team-ready format:
| Priority Tier | Feature | Score | Ratio to Lowest |
|---|---|---|---|
| Must-build | Real-time collaboration | 12.4 | 6.9x |
| Offline access | 9.8 | 5.4x | |
| Custom reporting | 8.7 | 4.8x | |
| Should-build | API access | 7.5 | 4.2x |
| Mobile app | 7.1 | 3.9x | |
| SSO/SAML | 6.3 | 3.5x | |
| Consider | Slack integration | 5.8 | 3.2x |
| Dark mode | 5.1 | 2.8x | |
| Defer | Custom branding | 3.9 | 2.2x |
| Gantt charts | 3.1 | 1.7x | |
| Emoji reactions | 1.8 | 1.0x |
The tier boundaries come from natural breaks in the score distribution. Look at the chart and you'll usually see gaps where clusters form. The gap between 6.3 and 5.8 is smaller than the gap between 8.7 and 7.5, so the tier break sits at the larger gap.
Segment-Level Insights
Run the analysis separately by segment. The most valuable finding is often where segments disagree:
| Feature | Enterprise Score | SMB Score | Gap |
|---|---|---|---|
| SSO/SAML | 11.2 (rank #2) | 2.1 (rank #14) | 9.1 |
| API access | 9.8 (rank #3) | 3.4 (rank #11) | 6.4 |
| Mobile app | 4.1 (rank #9) | 10.3 (rank #1) | 6.2 |
This data directly informs tier differentiation. SSO and API access belong in the enterprise tier. Mobile app development should prioritize SMB use cases.
From MaxDiff to Roadmap
Map Scores to Effort
MaxDiff tells you what customers want. It doesn't account for engineering effort. Overlay the priority scores with estimated build cost to find the best return on investment:
- High priority + low effort = do first. These are quick wins that satisfy the most customer demand per engineering sprint.
- High priority + high effort = plan carefully. Schedule these for the next major release cycle.
- Low priority + low effort = nice-to-haves. Fill gaps between major projects.
- Low priority + high effort = don't build. These consume resources with minimal customer impact.
Run It Quarterly
Feature priorities shift as your product evolves, competitors move, and your customer base changes. Running MaxDiff quarterly (or at least semi-annually) keeps your roadmap aligned with current customer preferences rather than assumptions from six months ago.
Each wave takes 1-2 weeks to field and analyze. The item list will change between waves as you ship features and add new candidates. You can't compare scores across waves (different item lists produce different scales), but you can track whether the same feature types consistently rank at the top or whether priorities are shifting.
Pair With Conjoint for Pricing
MaxDiff tells you what to build. It doesn't tell you how to bundle or price it. If your next step is "should these features go in the free tier, the $49 tier, or the $99 tier?", follow the MaxDiff with a conjoint study using the top 6-7 features as attributes alongside price levels.
Real-World Example: B2B Analytics Platform
A B2B analytics company tested 22 candidate features with 350 current customers segmented by company size. The MaxDiff revealed that "natural language querying" (AI-powered "ask a question, get a chart") ranked #1 overall, 2.5x higher than the product team's top internal priority ("improved data connector library").
The segment split was even more revealing: mid-market companies ranked natural language querying #1, while enterprise companies ranked "role-based access controls" #1 and natural language querying #8. The company accelerated natural language querying for the mid-market tier and role-based access for the enterprise tier, rather than building a single shared roadmap.
Frequently Asked Questions
How often should we run feature prioritization studies?
Quarterly if you're iterating quickly, semi-annually if your product cycles are longer. Each study takes 1-2 weeks and 200-300 respondents. The cost is modest relative to the engineering spend it informs.
Should we include features we've already decided to build?
Generally no. MaxDiff is most useful for features where the priority is uncertain. Including committed features wastes item slots and respondent effort. The exception: if leadership wants validation that a committed feature is genuinely high-priority, include it as a baseline check.
Can MaxDiff handle both features and bug fixes?
It can, but the comparison feels unnatural to respondents. "Add dark mode" and "Fix login crash on Android" are different categories of work. If you need to prioritize across categories, run separate MaxDiff studies for features and bug fixes, or frame the items consistently ("improvements to the product" rather than mixing new features and fixes).
Related Guides
- MaxDiff Analysis: Complete Guide -- Full methodology overview
- MaxDiff vs Conjoint -- When to follow MaxDiff with conjoint
- How to Design a MaxDiff Survey -- Setting up the study
- How to Interpret MaxDiff Results -- Reading and presenting scores
- Concept Testing -- For evaluating complete product concepts
- Feature Prioritization Survey Template -- Ready-to-use MaxDiff template
Prioritize with data -- try Quali-Fi free for 14 days.