# Causal Inference

Causal inference uses assumptions, study design, and statistical methods to estimate what an intervention changed beyond observed association.

- Type: framework
- Domain: Data, experimentation & growth
- Level: Advanced
- Last reviewed: 2026-09-23
- Original: [Soroush’s Product Wiki](<https://wiki.soroush.uk/topic/causal-inference/>)

## What it means

Causal inference is the discipline of reasoning about how an outcome would differ under alternative actions or exposures. Because the same unit cannot be observed simultaneously under treatment and control, teams need a credible comparison, an explicit causal model, and assumptions connecting observed data to the counterfactual question. Randomized experiments are one design; observational methods require additional care about confounding and selection.

## Why it matters

Product data contains abundant correlations that can mislead decisions. Highly engaged users may adopt a feature because they were already likely to retain, making feature use look causal. Causal reasoning forces teams to state the intervention, population, outcome, time horizon, and assumptions, reducing the chance that prediction, segmentation, or before-and-after movement is presented as impact.

## When to use it

Use causal inference when a decision asks what will happen if the product changes an action, policy, price, message, or experience. Prefer randomized designs when feasible and ethical. For observational analysis, involve appropriate expertise and use domain knowledge to identify confounders, mediators, selection mechanisms, and measurement problems before choosing a method.

## How it works

1. Formulate a precise causal question specifying intervention, comparison, population, outcome, and time horizon.
2. Draw or otherwise state the assumed relationships among treatment, outcome, confounders, mediators, and selection variables.
3. Choose a design—randomization, natural experiment, matching, weighting, regression discontinuity, difference-in-differences, or another justified approach.
4. Assess identification assumptions, overlap, measurement, interference, missingness, and sensitivity to plausible violations.
5. Estimate effects with uncertainty and communicate which conclusions follow from data versus untestable assumptions.

## A practical example

Users who enable collaborative editing retain more often, but the team does not conclude that enabling it causes retention. Larger teams are both more likely to collaborate and more likely to renew. The company defines the intervention, randomizes an onboarding prompt among eligible accounts, and estimates the effect of encouraging adoption rather than comparing self-selected users.

## Where it breaks

Causal estimates are only as credible as their design, measurements, and assumptions. Statistical adjustment cannot guarantee that every confounder was measured, and complex methods can conceal fragile identification. Effects may vary across people and time, while interference between users can violate standard assumptions. Product judgment is still needed to decide whether an estimated effect is valuable or ethical.

## Common mistakes

- Describing correlation, prediction, or temporal order as proof of causation.
- Selecting an advanced estimator before defining the intervention and causal assumptions.
- Controlling for variables caused by the treatment or restricting analysis to a selected post-treatment population.

## Visualization

[View the visualization on the website](<https://wiki.soroush.uk/topic/causal-inference/#visualization-causal-inference>)

## Sources

1. [Causal Inference: What If](<https://www.hsph.harvard.edu/miguel-hernan/wp-content/uploads/sites/1268/2024/01/hernanrobins_WhatIf_2jan24.pdf>) — Harvard T.H. Chan School of Public Health · Foundational textbook
2. [Causal Models](<https://plato.stanford.edu/entries/causal-models/>) — Stanford Encyclopedia of Philosophy · Scholarly reference

## Related topics

- [A/B Testing](<https://wiki.soroush.uk/topic/a-b-testing/>)
- [Data-Informed Decision Making](<https://wiki.soroush.uk/topic/data-informed-decision-making/>)
- [Triangulation](<https://wiki.soroush.uk/topic/triangulation/>)
