# Generative AI

Generative AI uses learned patterns to produce new text, images, audio, video, code, or other content in response to input.

- Type: term
- Domain: Engineering & architecture
- Level: Foundational
- Last reviewed: 2026-09-26
- Original: [Soroush’s Product Wiki](<https://wiki.soroush.uk/topic/generative-ai/>)

## What it means

Generative AI is a class of AI models designed to generate synthetic content resembling patterns in their training data. A user or system supplies a prompt or other input, and the model produces a probable output rather than retrieving a guaranteed stored answer. Large language models are one kind of generative model; not all AI is generative and not all generated content is correct or original.

## Why it matters

Generative systems make flexible natural-language and media interfaces practical, but variability and plausible errors alter how products must be specified, tested, explained, and controlled. They also introduce concerns about provenance, intellectual property, privacy, misuse, and the cost of reviewing output.

## When to use it

Use generative AI for drafting, transformation, exploration, summarization, or assistance when output can be checked and recovery is easy. Apply stronger evidence, approval, and access controls—or do not use it—for high-impact decisions, sensitive data, irreversible actions, and tasks requiring exact factual or legal guarantees.

## How it works

1. Define the content task, user value, acceptable variation, and consequences of a wrong output.
2. Select a model and grounding, prompting, or adaptation approach appropriate to the modality and domain.
3. Constrain inputs, data access, output format, tools, and permissions according to the threat model.
4. Evaluate representative and adversarial cases for usefulness, factuality, safety, bias, and consistency.
5. Design disclosure, review, correction, fallback, feedback, and monitoring into the user journey.

## A practical example

A research repository offers generated summaries of approved interview notes. Each summary links back to source passages, carries an AI label, can be edited, and is evaluated for unsupported claims; raw restricted studies remain outside the model's retrieval scope.

## Where it breaks

Outputs are sampled from learned distributions and may be false, stereotyped, unsafe, or derivative. Model and vendor behavior can change. Grounding and guardrails reduce some risks but do not guarantee truth or compliance, and review effort can erase expected productivity gains.

## Common mistakes

- Treating generated content as retrieved fact or original user evidence.
- Evaluating only impressive examples instead of a defined distribution of real tasks and failures.
- Uploading sensitive or copyrighted material without authority and data controls.
- Hiding AI involvement where users need it to judge, verify, or contest an output.

## Visualization

[View the visualization on the website](<https://wiki.soroush.uk/topic/generative-ai/#visualization-generative-ai>)

## Sources

1. [Artificial Intelligence Risk Management Framework: Generative Artificial Intelligence Profile](<https://nvlpubs.nist.gov/nistpubs/ai/NIST.AI.600-1.pdf>) — National Institute of Standards and Technology · Government framework
2. [Machine Learning Glossary: Generative AI](<https://developers.google.com/machine-learning/glossary/generative>) — Google for Developers · Official technical glossary

## Related topics

- [Foundation Model](<https://wiki.soroush.uk/topic/foundation-model/>)
- [Large Language Model \(LLM\)](<https://wiki.soroush.uk/topic/large-language-model/>)
- [AI-Assisted Design](<https://wiki.soroush.uk/topic/ai-assisted-design/>)
