Skip to content
On this page Definition

Atlas · DS173 · Interaction pattern: Multiple Channels

Multimodal UI

Combines text, touch, voice, image and other equivalent channels.

  • Status in 2026: Active. In current use.
  • Trend 2027 to 2030: Rising (an editorial projection, not a forecast).
  • The term: Known technical term or standard.

Definition

Combines text, touch, voice, image and other equivalent channels.

Traits

  • combined controls

Typical settings: Copilots, health, mobility.

When to use it, and when not

Consider it when the task and motivation match: people with varied contexts of use. Typical settings: copilots, health, mobility.

Be careful when the risk below would hurt the main task: inconsistency between modalities.

UX risk and how to reduce it

Risk: Inconsistency between modalities.

Mitigation and accessibility: Unified state and equivalent alternatives.

How to check: Test a prototype against a plain baseline on a real task: completion, time, errors, comprehension, accessibility and preference, segmented by context rather than by stereotype.

Evidence

Indirect: the sources support underlying principles, not a preference for this style.

The sources below support the principles that apply to this term. None of them shows that this style works better or is preferred.

Heuristic scales

Relative editorial judgements from 1 to 5. They are not results of a study and not a measure of quality.

Visual complexity heuristic
3 / 5 (1 is few visual elements, 5 is many layered elements)
Expressiveness heuristic
3 / 5 (1 is restrained, neutral, 5 is highly expressive)
Information density heuristic
3 / 5 (1 is sparse, 5 is dense)

In our library

No design-style recipe in @codeatlasdev/ui implements this term yet. You can still build it from the --ca-* tokens: see Theming.

Prompt for your AI

Paste this into a coding agent. It carries the trade-offs, and asks for a baseline to compare against.

Design this interface in the "Multimodal UI" direction (interaction pattern, multiple channels): Combines text, touch, voice, image and other equivalent channels.
Visual and interaction traits to use: combined controls.
Main UX risk: Inconsistency between modalities. Mitigate it: Unified state and equivalent alternatives.
Keep it accessible to WCAG 2.2 AA: contrast, visible focus, keyboard operation, 24 px minimum targets, reflow at 320 CSS px and reduced motion.
Keep the content, hierarchy and behavior the same as a plain baseline so the two can be compared. Do not claim the style performs better; the choice should be validated with users.

References

  1. W3C Web Accessibility Initiative (2021). WCAG 2 supplemental guidance. W3C WAI.Standard or guideline

    Supports: W3C WAI lists supplemental guidance for improving accessibility beyond what WCAG 2 requires, including a cognitive accessibility guidance set.

    Does not support: Normative requirements: supplemental guidance is advisory, not required for conformance. This page is an index; a specific recommendation needs the linked document.

    Checked 2026-10-25.

  2. Luera, Rossi, Siu, Dernoncourt, Yu, Kim, Zhang, Chen, Salehy, Lipka, Basu, Mathur, Zhao (2025). Survey on User Interface Design and Interactions for Generative AI Applications. Foundations and Trends in Human-Computer Interaction.Supported

    Supports: A survey that presents taxonomies of how a human interacts with AI and of the user-interaction patterns designed for a variety of generative AI use cases, as a reference for designers and developers. It focuses primarily on user-guided interactions, those the user initiates.

    Does not support: That any pattern works better, or that a generative interface should act without the user's direction: the survey leaves out implicit signals from the user and reports no outcome comparison. The abstract read is the arXiv version of the same survey (earlier title); the published monograph's own text was not reachable.

    Checked 2026-10-25.