# Sampling in User Research

The deliberate selection of participants or cases whose evidence can support a research question within stated boundaries.

- Type: framework
- Domain: Research & behavior
- Level: Intermediate
- Last reviewed: 2026-09-25
- Original: [Soroush’s Product Wiki](<https://wiki.soroush.uk/topic/sampling-in-user-research/>)

## What it means

Sampling in user research defines the population or context of interest and how participants, cases, events, or records are selected from it. Probability sampling gives eligible units a known chance of selection and supports statistical inference when implemented well. Nonprobability approaches such as purposive, quota, and convenience sampling serve different aims but require narrower claims.

## Why it matters

Findings depend on who and what was available to produce the evidence. A large convenient sample can systematically exclude important users, while a small purposive sample can be appropriate for understanding a specific experience. An explicit sampling rationale prevents headcount from being mistaken for representativeness.

## When to use it

Make sampling decisions whenever research uses a subset of a wider population, whether for interviews, usability studies, surveys, logs, or field sites. Match the approach to whether the goal is depth, variation, issue discovery, comparison, estimation, or generalization.

## How it works

1. Define the target population, unit of analysis, and claim the study needs to support.
2. Identify characteristics, contexts, or sources of variation relevant to the research question.
3. Choose probability or nonprobability sampling and document why it fits the intended inference.
4. Recruit or select cases consistently while monitoring coverage, refusals, and practical exclusions.
5. Report who was included, who was not reached, and how selection limits the conclusion.

## A practical example

A team studying expense approvals purposively recruits requesters, managers, and finance reviewers from small and large organizations to understand workflow variation. It does not report the proportion of all customers with each problem; a later probability survey estimates prevalence across the customer base.

## Where it breaks

No sampling strategy repairs a poorly defined population or weak measurement. Probability samples can still suffer nonresponse and coverage error, while purposive samples depend on informed selection and may miss unexpected variation. Demographic quotas alone do not make a sample random or substantively representative.

## Common mistakes

- Using whoever is easiest to reach while describing them as representative users.
- Choosing a sample size before defining the decision, variation, or intended inference.
- Generalizing percentages from purposive or convenience samples to the full customer population.

## Visualization

[View the visualization on the website](<https://wiki.soroush.uk/topic/sampling-in-user-research/#visualization-sampling-in-user-research>)

## Sources

1. [Convenience vs. Probability Sampling in UX Research](<https://www.nngroup.com/articles/convenience-vs-probability-sampling/>) — Nielsen Norman Group · Professional guidance
2. [Purposeful sampling for qualitative data collection and analysis in mixed method implementation research](<https://pmc.ncbi.nlm.nih.gov/articles/PMC4012002/>) — Administration and Policy in Mental Health and Mental Health Services Research · Peer-reviewed research

## Related topics

- [Participant Recruitment](<https://wiki.soroush.uk/topic/participant-recruitment/>)
- [Research Screener](<https://wiki.soroush.uk/topic/research-screener/>)
- [Research Saturation](<https://wiki.soroush.uk/topic/research-saturation/>)
