artifactEngineering & architecture

Dataset Card

A dataset card records a dataset's origins, composition, collection and labeling decisions, permitted uses, and limitations for informed reuse.

Download Markdown (.md)

01What it means

A dataset card is documentation that helps consumers judge whether a particular dataset version fits a task. Datasheets for datasets provide a closely related, more extensive documentation approach; formats differ, but both describe provenance, composition, preparation, intended uses, distribution, and maintenance. Unlike a database schema, a card explains how the data came to represent the world and where that representation is incomplete.[1][2]

A dataset's evidence, provenance, and limits in one reviewable record Document where the data came from and what responsible reuse requires
Purpose + owners
Why the dataset exists and who maintains it
Composition
Records, fields, populations, and coverage
Collection
Sources, consent, sampling, and time period
Labeling + processing
Instructions, transformations, and quality review
Access + governance
Permissions, licensing, retention, and deletion
Intended uses
Supported tasks and operating conditions
Excluded uses
Unsafe, unsupported, or prohibited applications
Limitations
Gaps, bias, uncertainty, and known failure modes

A dataset card supports informed assessment; it does not make harmful collection lawful, remove bias, or certify fitness for a new context.

02Why it matters

Model behavior and evaluation credibility depend on the data used. Product teams can use dataset documentation to challenge sampling gaps, unclear labels, incompatible permissions, and claims of representativeness before investing in training or treating an evaluation score as evidence.

03When to use it

Create or review a card for training, evaluation, or shared research datasets, particularly when ownership changes or data is reused for a new purpose. It complements access and retention controls; documenting a dataset does not make otherwise impermissible reuse acceptable.

04How it works

  1. Identify the dataset version, purpose, owner, source populations, collection period, and unit of observation.
  2. Describe sampling, collection, consent or permissions, labeling instructions, annotator disagreement, and exclusions.
  3. Document fields, missingness, transformations, splits, duplicates, and known coverage gaps.
  4. Specify supported and discouraged uses, distribution conditions, access restrictions, and maintenance responsibilities.
  5. Review the documentation with data producers and consumers, record unresolved questions, and revise it when the dataset changes.

05A practical example

Example

A PM reviews a dataset card before training a ticket classifier. It reveals that closed tickets were sampled but unresolved escalations were excluded. The team adds an escalation sample and revises its evaluation plan because the original dataset understated difficult cases.

06Where it breaks

Documentation cannot recover unknown provenance or prove data quality. Categories and labels can themselves encode flawed assumptions. Detailed disclosure must avoid exposing personal information, and maintaining the card requires cooperation from data owners.

Common mistakes

  • Equating a field dictionary with complete dataset documentation.
  • Claiming a sample is representative without identifying a target population.
  • Assuming documentation or public availability grants permission for every reuse.
  • Keeping one card while changing dataset contents, labels, or splits silently.

07Sources

  1. Datasheets for DatasetsCommunications of the ACM · Peer-reviewed researchDatasheets for Datasets
  2. Dataset CardsHugging Face · Official documentationDataset Cards
View saved topics

Start typing to search titles, definitions, categories, and frameworks.