Atlas · DS228 · Interaction pattern: Multimodal
Voice + Visual Companion UI
Speech channel combined with a screen for checking state.
- Status in 2026: Active. In current use.
- Trend 2027 to 2030: Rising (an editorial projection, not a forecast).
- The term: Known technical term or standard.
Definition
Speech channel combined with a screen for checking state.
Traits
- speech
- transcript
- cards
Typical settings: Mobility, Home, Assistance.
When to use it, and when not
Consider it when the task and motivation match: people multitasking. Typical settings: mobility, home, assistance.
Be careful when the risk below would hurt the main task: depends on a quiet environment.
The audience is a hypothesis
"People multitasking" describes a motivation, task or context for which this direction tends to be chosen. It was not measured, and it says nothing about any age, gender or other group.
UX risk and how to reduce it
Risk: Depends on a quiet environment.
Mitigation and accessibility: Text input and visual confirmation.
How to check: Test a prototype against a plain baseline on a real task: completion, time, errors, comprehension, accessibility and preference, segmented by context rather than by stereotype.
Evidence
Indirect: the sources support underlying principles, not a preference for this style.
The sources below support the principles that apply to this term. None of them shows that this style works better or is preferred.
- Luera 2025 (Supported): Interaction patterns for generative AI.
- W3C Web Accessibility Initiative 2021 (Standard or guideline): Cognitive accessibility guidance.
Heuristic scales
Relative editorial judgements from 1 to 5. They are not results of a study and not a measure of quality.
- Visual complexity heuristic
- 2 / 5 (1 is few visual elements, 5 is many layered elements)
- Expressiveness heuristic
- 2 / 5 (1 is restrained, neutral, 5 is highly expressive)
- Information density heuristic
- 3 / 5 (1 is sparse, 5 is dense)
In our library
No design-style recipe in @codeatlasdev/ui implements this term yet. You can still build it from the --ca-* tokens: see Theming.
Prompt for your AI
Paste this into a coding agent. It carries the trade-offs, and asks for a baseline to compare against.
Design this interface in the "Voice + Visual Companion UI" direction (interaction pattern, multimodal): Speech channel combined with a screen for checking state. Visual and interaction traits to use: speech, transcript, cards. Main UX risk: Depends on a quiet environment. Mitigate it: Text input and visual confirmation. Keep it accessible to WCAG 2.2 AA: contrast, visible focus, keyboard operation, 24 px minimum targets, reflow at 320 CSS px and reduced motion. Keep the content, hierarchy and behavior the same as a plain baseline so the two can be compared. Do not claim the style performs better; the choice should be validated with users.
References
Luera, Rossi, Siu, Dernoncourt, Yu, Kim, Zhang, Chen, Salehy, Lipka, Basu, Mathur, Zhao (2025). Survey on User Interface Design and Interactions for Generative AI Applications. Foundations and Trends in Human-Computer Interaction.Supported
Supports: A survey that presents taxonomies of how a human interacts with AI and of the user-interaction patterns designed for a variety of generative AI use cases, as a reference for designers and developers. It focuses primarily on user-guided interactions, those the user initiates.
Does not support: That any pattern works better, or that a generative interface should act without the user's direction: the survey leaves out implicit signals from the user and reports no outcome comparison. The abstract read is the arXiv version of the same survey (earlier title); the published monograph's own text was not reachable.
Checked 2026-10-25.
W3C Web Accessibility Initiative (2021). WCAG 2 supplemental guidance. W3C WAI.Standard or guideline
Supports: W3C WAI lists supplemental guidance for improving accessibility beyond what WCAG 2 requires, including a cognitive accessibility guidance set.
Does not support: Normative requirements: supplemental guidance is advisory, not required for conformance. This page is an index; a specific recommendation needs the linked document.
Checked 2026-10-25.