Wizard of Oz Prototype
A prototype whose apparently automated responses are produced partly or entirely by a person behind the scenes during a moderated study.
Download Markdown (.md)Soroush’s Product Wiki · https://wiki.soroush.uk/topic/wizard-of-oz-prototype/
01What it means
A Wizard of Oz prototype lets a participant interact with an interface or service that appears to respond autonomously while a hidden operator generates or selects responses. It tests interaction, expectations, and system behavior before expensive dynamic technology is implemented.[1][2]
02Why it matters
Static screens cannot represent every conversational, personalized, intelligent, or real-time interaction. Human simulation lets a team explore these experiences and uncover requirements while the underlying system remains uncertain or costly.
03When to use it
Use it for dynamic concepts such as assistants, recommendations, data lookups, or novel input when realistic responses are essential to the research question. Use a simpler prototype when fixed states are sufficient, and review deception and safety risks before the session.
04How it works
- Define the interactions and risks that require realistic dynamic responses.
- Design the visible prototype, operator controls, response rules, boundaries, and failure states.
- Rehearse timing and consistency with a facilitator, operator, and realistic tasks.
- Obtain appropriate consent, run the moderated session, and record both participant and operator actions.
- Debrief any material deception, analyse expectations and breakdowns, and separate prototype performance from technical feasibility.
05A practical example
A support team tests an AI troubleshooting assistant while a specialist selects responses from a controlled library. Sessions reveal that users expect evidence and escalation controls before engineering commits to a model architecture.
06Where it breaks
A skilled human can provide context, judgment, speed, or accuracy the eventual system cannot match. Operator inconsistency affects results, technical feasibility remains unresolved, and concealed human control raises ethical concerns requiring review and debriefing.
Common mistakes
- Simulating capabilities that the team has no plausible way to deliver.
- Failing to script operator boundaries and producing inconsistent experiences.
- Treating positive interaction with a human-quality simulation as proof an automated system will work.
07Sources
- The Wizard of Oz Method in UXNielsen Norman Group · Professional guidanceThe Wizard of Oz Method in UX
- UX Research Methods: GlossaryNielsen Norman Group · Professional referenceUX Research Methods: Glossary