Hypothesis-Driven Design
A practice that expresses product ideas as falsifiable beliefs about users, changes, and outcomes, then uses evidence to guide design decisions.
Download Markdown (.md)Soroush’s Product Wiki · https://wiki.soroush.uk/topic/hypothesis-driven-design/
01What it means
Hypothesis-driven design treats proposed solutions as uncertain claims rather than requirements. A useful hypothesis identifies the audience, intended change, expected outcome, and evidence that would increase or decrease confidence, allowing a team to learn before scaling implementation.[1][2]
- 01Problem + decisionWhy a change is being considered
- 02HypothesisAudience, change, behavior, outcome
- 03AssumptionsWhat must hold for success
- 04Smallest ethical testEvidence aimed at the riskiest belief
- 05Update confidenceAct on supportive, null, or contrary evidence
Evidence thresholds are selected before the test so a team can continue, revise, combine, or abandon the idea honestly.
02Why it matters
Feature language hides uncertainty and encourages teams to judge success by shipping. Hypotheses make assumptions discussable, connect design choices to outcomes, and support tests that can change a decision. They also help teams distinguish learning goals from delivery tasks.
03When to use it
Use it when exploring a new experience, prioritizing competing product bets, or working where customer behavior and business outcomes are uncertain. It is less valuable for mandatory compliance changes whose implementation is known, though usability assumptions may still be tested.
04How it works
- Start with the customer or business problem and the decision to be made.
- State the target audience, proposed change, expected behavior, and outcome.
- List the assumptions that must hold for the hypothesis to succeed.
- Prioritize assumptions by risk and select evidence thresholds in advance.
- Choose the smallest ethical test that can produce decision-relevant evidence.
- Update confidence and decide to continue, revise, combine, or abandon the idea.
05A practical example
A music app hypothesizes that new listeners who can preview a personalized mix before registering will be more likely to complete signup because the value becomes concrete. The team prototypes the preview, measures qualified signup behavior, and checks whether any lift harms later retention.
06Where it breaks
A precisely written hypothesis can still rest on a weak problem frame or misleading metric. Short experiments may optimize local behavior while damaging trust or long-term outcomes. Statistical tests are not always appropriate, and failure to define thresholds invites post-hoc storytelling.
Common mistakes
- Writing “users will like this feature” with no observable outcome.
- Choosing metrics after seeing results.
- Testing a minor interface detail while the value proposition remains uncertain.
07Sources
- The Hypothesis Prioritization CanvasJeff Gothelf · Creator-authored methodThe Hypothesis Prioritization Canvas
- How I Break Down Hypotheses to Make Them Easier to TestJeff Gothelf · Creator-authored guideHow I Break Down Hypotheses to Make Them Easier to Test