# Randomization

Randomization assigns eligible units to conditions by chance so that groups are comparable before the intervention on average.

- Type: method
- Domain: Data, experimentation & growth
- Level: Intermediate
- Last reviewed: 2026-10-05
- Original: [Soroush’s Product Wiki](<https://wiki.soroush.uk/topic/randomization/>)

## What it means

Randomization is deliberate assignment by chance rather than user choice. In controlled experiments it supports causal comparisons by balancing pre-treatment factors in expectation, subject to correct implementation and sufficient sample size.

## Why it matters

Without credible assignment, feature effects can be selection effects. Randomization makes a treatment-control comparison stronger causal evidence than a self-selected or before-and-after comparison.

## When to use it

Use randomization for feasible, ethical interventions when estimating impact. Define unit, eligibility, persistence, allocation, and interference risks before launch.

## How it works

1. Choose eligible population and assignment unit.
2. Generate and persist the planned assignments.
3. Keep eligibility, exposure, and logging comparable.
4. Check allocation and baseline data quality.
5. Estimate effects using assigned groups and document deviations.

## A practical example

A team randomizes organizations, not individual members, to a collaboration home because members share a workspace. It checks assignment integrity before comparing activation.

## Where it breaks

Randomization cannot fix missing events, noncompliance, spillovers, or a poor outcome definition. Some changes cannot be randomized safely or fairly.

## Common mistakes

- Assigning by a unit that allows spillover.
- Allowing eligibility to differ by variant.
- Assuming assignment removes the need for data-quality checks.

## Visualization

[View the visualization on the website](<https://wiki.soroush.uk/topic/randomization/#visualization-randomization>)

## Sources

1. [ICH E9 Statistical Principles for Clinical Trials](<https://database.ich.org/sites/default/files/E9_Guideline.pdf>) — International Council for Harmonisation · International guideline
2. [NIST/SEMATECH e-Handbook of Statistical Methods](<https://www.itl.nist.gov/div898/handbook/>) — National Institute of Standards and Technology · Government statistical reference

## Related topics

- [A/B Testing](<https://wiki.soroush.uk/topic/a-b-testing/>)
- [Sample Ratio Mismatch](<https://wiki.soroush.uk/topic/sample-ratio-mismatch/>)
- [Causal Inference](<https://wiki.soroush.uk/topic/causal-inference/>)
