Dataset Card
A dataset card records a dataset's origins, composition, collection and labeling decisions, permitted uses, and limitations for informed reuse.
Download Markdown (.md)Soroush’s Product Wiki · https://wiki.soroush.uk/topic/dataset-card/
01What it means
A dataset card is documentation that helps consumers judge whether a particular dataset version fits a task. Datasheets for datasets provide a closely related, more extensive documentation approach; formats differ, but both describe provenance, composition, preparation, intended uses, distribution, and maintenance. Unlike a database schema, a card explains how the data came to represent the world and where that representation is incomplete.[1][2]
- Purpose + owners
- Why the dataset exists and who maintains it
- Composition
- Records, fields, populations, and coverage
- Collection
- Sources, consent, sampling, and time period
- Labeling + processing
- Instructions, transformations, and quality review
- Access + governance
- Permissions, licensing, retention, and deletion
- Intended uses
- Supported tasks and operating conditions
- Excluded uses
- Unsafe, unsupported, or prohibited applications
- Limitations
- Gaps, bias, uncertainty, and known failure modes
A dataset card supports informed assessment; it does not make harmful collection lawful, remove bias, or certify fitness for a new context.
02Why it matters
Model behavior and evaluation credibility depend on the data used. Product teams can use dataset documentation to challenge sampling gaps, unclear labels, incompatible permissions, and claims of representativeness before investing in training or treating an evaluation score as evidence.
03When to use it
Create or review a card for training, evaluation, or shared research datasets, particularly when ownership changes or data is reused for a new purpose. It complements access and retention controls; documenting a dataset does not make otherwise impermissible reuse acceptable.
04How it works
- Identify the dataset version, purpose, owner, source populations, collection period, and unit of observation.
- Describe sampling, collection, consent or permissions, labeling instructions, annotator disagreement, and exclusions.
- Document fields, missingness, transformations, splits, duplicates, and known coverage gaps.
- Specify supported and discouraged uses, distribution conditions, access restrictions, and maintenance responsibilities.
- Review the documentation with data producers and consumers, record unresolved questions, and revise it when the dataset changes.
05A practical example
A PM reviews a dataset card before training a ticket classifier. It reveals that closed tickets were sampled but unresolved escalations were excluded. The team adds an escalation sample and revises its evaluation plan because the original dataset understated difficult cases.
06Where it breaks
Documentation cannot recover unknown provenance or prove data quality. Categories and labels can themselves encode flawed assumptions. Detailed disclosure must avoid exposing personal information, and maintaining the card requires cooperation from data owners.
Common mistakes
- Equating a field dictionary with complete dataset documentation.
- Claiming a sample is representative without identifying a target population.
- Assuming documentation or public availability grants permission for every reuse.
- Keeping one card while changing dataset contents, labels, or splits silently.
07Sources
- Datasheets for DatasetsCommunications of the ACM · Peer-reviewed researchDatasheets for Datasets
- Dataset CardsHugging Face · Official documentationDataset Cards