MaxDiff
MaxDiff estimates relative preferences by asking respondents to choose the most and least preferred items from repeated subsets.
Download Markdown (.md)Soroush’s Product Wiki · https://wiki.soroush.uk/topic/maxdiff/
01What it means
MaxDiff, also called maximum difference scaling or best-worst item scaling, is a survey method for comparing a list of items. Respondents make repeated best-and-worst selections from small sets. Analysis estimates relative preference or importance scores within that item universe; it does not directly estimate willingness to pay.[1][2]
02Why it matters
When people rate every feature as important, ordinary rating scales provide little separation. Forced comparisons expose tradeoffs and can help a team understand which benefits or messages stand out for different groups.
03When to use it
Use MaxDiff when comparing distinct items under one consistent question. Use conjoint analysis for tradeoffs among multi-attribute packages. Poorly understood items or a list containing multiple ideas per item should be resolved before fielding the study.
04How it works
- Define the decision and write clear, comparable items.
- Choose a sample and a survey design with adequate item exposure and comparisons.
- Pilot the wording and cognitive workload.
- Collect most-and-least choices across the designed sets.
- Estimate scores with a suitable model and examine uncertainty and segments.
- Use the relative results alongside cost, feasibility, and behavioral evidence.
05A practical example
A collaboration product compares twelve benefits, including finding previous decisions and reducing status meetings. Its target users repeatedly favor decision retrieval. The team investigates that need in interviews before selecting a feature implementation.
06Where it breaks
Results depend on which items were included and how they were worded. Relative scores are not the percentage of people who will buy a feature. Design and estimation choices need expertise, and an aggregate ranking can conceal conflicting segments.
Common mistakes
- Interpreting preference scores as purchase probabilities.
- Comparing scores from different item lists as if their scales were identical.
- Combining several benefits into one attractive item.
07Sources
- MaxDiffSawtooth Software · Method documentationMaxDiff
- MaxDiff Analysis Technical OverviewQualtrics · Method documentationMaxDiff Analysis Technical Overview