# Minimum Detectable Effect

A minimum detectable effect is the smallest effect an experiment is designed to detect with specified power, error control, and assumptions.

- Type: metric
- Domain: Data, experimentation & growth
- Level: Advanced
- Last reviewed: 2026-10-05
- Original: [Soroush’s Product Wiki](<https://wiki.soroush.uk/topic/minimum-detectable-effect/>)

## What it means

The minimum detectable effect, or MDE, is a design sensitivity target derived from sample size, variability, allocation, testing method, and error rates. It is not the smallest effect that could matter to the product, although the two should be compared.

## Why it matters

MDE makes an experiment’s resolution visible before launch and prevents teams from treating a short test as able to distinguish a valuable small gain from no meaningful change.

## When to use it

Use MDE in experiment planning to determine whether available traffic can answer the product question. Redesign, lengthen, or decline the test when sensitivity is too coarse.

## How it works

1. Define the primary metric and decision-relevant effect.
2. Set power, error rates, allocation, and analysis horizon.
3. Estimate baseline variability and eligible sample size.
4. Calculate the MDE and compare it with the practical threshold.
5. Document any justified design change before analysis.

## A practical example

A team can detect only a three-point conversion change in two weeks, while a one-point change would matter commercially. It extends the test rather than calling the shorter one inconclusive.

## Where it breaks

MDE depends on model assumptions and says neither whether an observed effect is real nor whether it is valuable. Optimistic variance or effect assumptions can make a plan misleading.

## Common mistakes

- Confusing the MDE with the expected effect.
- Choosing an MDE larger than the decision-relevant effect.
- Ignoring traffic or variance changes after planning.

## Visualization

[View the visualization on the website](<https://wiki.soroush.uk/topic/minimum-detectable-effect/#visualization-minimum-detectable-effect>)

## Sources

1. [Engineering Statistics Handbook](<https://www.itl.nist.gov/div898/handbook/>) — National Institute of Standards and Technology · Government statistical reference
2. [ASA Statement on Statistical Significance and P-Values](<https://www.amstat.org/asa/files/pdfs/P-ValueStatement.pdf>) — American Statistical Association · Professional society statement

## Related topics

- [Statistical Power](<https://wiki.soroush.uk/topic/statistical-power/>)
- [Sample Size](<https://wiki.soroush.uk/topic/sample-size/>)
- [Practical Significance](<https://wiki.soroush.uk/topic/practical-significance/>)
