MaxDiff Analysis

Feature Prioritization with MaxDiff

7 min read

How product teams use MaxDiff analysis to prioritize features, validate roadmaps, and align stakeholders with customer data. Includes study design templates and examples.

Feature Prioritization with MaxDiff

Why Product Teams Use MaxDiff for Prioritization

Feature prioritization is MaxDiff's single strongest use case. Product teams typically face a list of 15-30 candidate features competing for engineering time, and they need a data-backed rank order that settles internal debates and aligns the roadmap to what customers actually want.

MaxDiff works for this because it forces trade-offs. A feature survey that asks "How important is Feature X? (1-5)" produces a flat landscape where everything scores 3.5-4.5. MaxDiff forces respondents to choose which feature matters most and which matters least from every set, producing a steep curve with clear winners and losers.

The result is a rank-ordered list where you can say "Feature A is 4x more preferred than Feature B" with statistical confidence. That's a product decision, not an opinion.

Setting Up a Feature Prioritization Study

Step 1: Gather Candidate Features

Pull feature ideas from every source: customer feedback tickets, sales team requests, competitive analysis, internal roadmap brainstorms, and churned customer interviews. Cast a wide net. You'll screen down in the next step.

Step 2: Screen to 15-25 Features

MaxDiff works best with 15-25 items. If you start with 40+ candidates, run a quick internal screen: eliminate duplicates, merge similar items, and remove features that are already committed or already ruled out. The MaxDiff should test features where the priority is genuinely uncertain.

Step 3: Write Feature Descriptions

Each feature needs a 3-8 word description that's immediately understandable to your target respondent. Some guidelines:

Too Vague Too Technical Just Right
Better reporting Implement GraphQL resolvers for report queries Custom report builder
Improved UX Reduce time-to-interactive by 40% Faster page load times
Security stuff OAuth 2.0 PKCE flow implementation Single sign-on (SSO)

The description should communicate what the user gets, not how the engineering team builds it. Test your descriptions with 3-5 people from your target audience before finalizing.

Step 4: Configure the MaxDiff

Standard configuration for feature prioritization:

  • Items per set: 4 (occasionally 5 for lists above 20 items)
  • Number of sets: 12-15 (each item appears at least 3 times)
  • Task wording: "Which feature is most important to you? Which is least important?"
  • Survey placement: After 2-3 context-setting questions, before demographics

Step 5: Target the Right Respondents

Feature preferences vary dramatically by user segment. Survey the people whose priorities should shape your roadmap:

  • Current users for retention-driven features
  • Trial users who didn't convert for acquisition-driven features
  • Churned customers for features that would have kept them
  • Prospects for features that would attract new customers

Mix your sample intentionally. An all-current-user sample will prioritize incremental improvements. An all-prospect sample will prioritize table-stakes features you might already have.

Plan for 200-300 respondents total, or 200+ per segment if you need segment-level comparisons. See the sample size guide for details.

Reading the Results

The Priority Stack

Your output is a ranked list of features with ratio-scaled scores. A typical product-team-ready format:

Priority Tier Feature Score Ratio to Lowest
Must-build Real-time collaboration 12.4 6.9x
Offline access 9.8 5.4x
Custom reporting 8.7 4.8x
Should-build API access 7.5 4.2x
Mobile app 7.1 3.9x
SSO/SAML 6.3 3.5x
Consider Slack integration 5.8 3.2x
Dark mode 5.1 2.8x
Defer Custom branding 3.9 2.2x
Gantt charts 3.1 1.7x
Emoji reactions 1.8 1.0x

The tier boundaries come from natural breaks in the score distribution. Look at the chart and you'll usually see gaps where clusters form. The gap between 6.3 and 5.8 is smaller than the gap between 8.7 and 7.5, so the tier break sits at the larger gap.

Segment-Level Insights

Run the analysis separately by segment. The most valuable finding is often where segments disagree:

Feature Enterprise Score SMB Score Gap
SSO/SAML 11.2 (rank #2) 2.1 (rank #14) 9.1
API access 9.8 (rank #3) 3.4 (rank #11) 6.4
Mobile app 4.1 (rank #9) 10.3 (rank #1) 6.2

This data directly informs tier differentiation. SSO and API access belong in the enterprise tier. Mobile app development should prioritize SMB use cases.

From MaxDiff to Roadmap

Map Scores to Effort

MaxDiff tells you what customers want. It doesn't account for engineering effort. Overlay the priority scores with estimated build cost to find the best return on investment:

  • High priority + low effort = do first. These are quick wins that satisfy the most customer demand per engineering sprint.
  • High priority + high effort = plan carefully. Schedule these for the next major release cycle.
  • Low priority + low effort = nice-to-haves. Fill gaps between major projects.
  • Low priority + high effort = don't build. These consume resources with minimal customer impact.

Run It Quarterly

Feature priorities shift as your product evolves, competitors move, and your customer base changes. Running MaxDiff quarterly (or at least semi-annually) keeps your roadmap aligned with current customer preferences rather than assumptions from six months ago.

Each wave takes 1-2 weeks to field and analyze. The item list will change between waves as you ship features and add new candidates. You can't compare scores across waves (different item lists produce different scales), but you can track whether the same feature types consistently rank at the top or whether priorities are shifting.

Pair With Conjoint for Pricing

MaxDiff tells you what to build. It doesn't tell you how to bundle or price it. If your next step is "should these features go in the free tier, the $49 tier, or the $99 tier?", follow the MaxDiff with a conjoint study using the top 6-7 features as attributes alongside price levels.

Real-World Example: B2B Analytics Platform

A B2B analytics company tested 22 candidate features with 350 current customers segmented by company size. The MaxDiff revealed that "natural language querying" (AI-powered "ask a question, get a chart") ranked #1 overall, 2.5x higher than the product team's top internal priority ("improved data connector library").

The segment split was even more revealing: mid-market companies ranked natural language querying #1, while enterprise companies ranked "role-based access controls" #1 and natural language querying #8. The company accelerated natural language querying for the mid-market tier and role-based access for the enterprise tier, rather than building a single shared roadmap.

Frequently Asked Questions

How often should we run feature prioritization studies?

Quarterly if you're iterating quickly, semi-annually if your product cycles are longer. Each study takes 1-2 weeks and 200-300 respondents. The cost is modest relative to the engineering spend it informs.

Should we include features we've already decided to build?

Generally no. MaxDiff is most useful for features where the priority is uncertain. Including committed features wastes item slots and respondent effort. The exception: if leadership wants validation that a committed feature is genuinely high-priority, include it as a baseline check.

Can MaxDiff handle both features and bug fixes?

It can, but the comparison feels unnatural to respondents. "Add dark mode" and "Fix login crash on Android" are different categories of work. If you need to prioritize across categories, run separate MaxDiff studies for features and bug fixes, or frame the items consistently ("improvements to the product" rather than mixing new features and fixes).


Prioritize with data -- try Quali-Fi free for 14 days.

Frequently Asked Questions

Related Guides

Put it into practice

Ready to apply this in your research?

Quali-Fi makes it easy to run surveys, conjoint studies, and more, all in one platform.