# Multimodal UI

DS173. Interaction pattern: Multiple Channels. Page: https://ui.codeatlas.com.br/atlas/multimodal-ui/. Index: https://ui.codeatlas.com.br/llms/atlas.txt

Combines text, touch, voice, image and other equivalent channels.

- Status in 2026: Active. In current use.
- Trend 2027 to 2030: Rising (an editorial projection, not a forecast).
- The term: Known technical term or standard.

## Traits

- combined controls

Typical settings: Copilots, health, mobility.

## When to use it, and when not

Consider it when the task and motivation match: people with varied contexts of use. Typical settings: copilots, health, mobility.

Be careful when the risk below would hurt the main task: inconsistency between modalities.

Audience (a hypothesis about motivation and task, never measured, not a statement about any group): People with varied contexts of use.

## UX risk and how to reduce it

- Risk: Inconsistency between modalities.
- Mitigation and accessibility: Unified state and equivalent alternatives.
- How to check: Test a prototype against a plain baseline on a real task: completion, time, errors, comprehension, accessibility and preference, segmented by context rather than by stereotype.

## Evidence

Indirect: the sources support underlying principles, not a preference for this style.

The sources support the principles that apply to this term. None shows that this style works better or is preferred.

- [E08] W3C Web Accessibility Initiative (2021). WCAG 2 supplemental guidance. https://www.w3.org/WAI/WCAG2/supplemental/ (Standard or guideline). Does not support: Normative requirements: supplemental guidance is advisory, not required for conformance. This page is an index; a specific recommendation needs the linked document.
- [E18] Luera, Rossi, Siu, Dernoncourt, Yu, Kim, Zhang, Chen, Salehy, Lipka, Basu, Mathur, Zhao (2025). Survey on User Interface Design and Interactions for Generative AI Applications. https://doi.org/10.1561/1100000106 (Supported). Does not support: That any pattern works better, or that a generative interface should act without the user's direction: the survey leaves out implicit signals from the user and reports no outcome comparison. The abstract read is the arXiv version of the same survey (earlier title); the published monograph's own text was not reachable.

## Limits

- The atlas is a broad, living catalogue, not every style that exists. No authority enumerates them, and the classes (movement, aesthetic, design system, layout, pattern, principle) overlap.
- The 1 to 5 scores are relative editorial judgements. They are not results of a study and not a measure of quality.
- An audience is a hypothesis about motivation, task and context. It was never measured and says nothing about any age, gender or other group.
- The sources support underlying principles (visual complexity, legibility, grouping, accessibility, platform conventions). None shows that a particular style works better or is preferred.
- The 2027 to 2030 trend is an editorial projection, not a forecast.
- Terms in the Future / AI category rest on exploratory work, some of it preprints, with no causal validation.

Last reviewed 2026-10-25.

## Heuristic scales

Relative editorial judgements from 1 to 5, not results of a study.

- Visual complexity: 3 / 5 (heuristic)
- Expressiveness: 3 / 5 (heuristic)
- Information density: 3 / 5 (heuristic)

## In our library

No design-style recipe implements this term yet; build it from `--ca-*` tokens.

## Prompt for your AI

```text
Design this interface in the "Multimodal UI" direction (interaction pattern, multiple channels): Combines text, touch, voice, image and other equivalent channels.
Visual and interaction traits to use: combined controls.
Main UX risk: Inconsistency between modalities. Mitigate it: Unified state and equivalent alternatives.
Keep it accessible to WCAG 2.2 AA: contrast, visible focus, keyboard operation, 24 px minimum targets, reflow at 320 CSS px and reduced motion.
Keep the content, hierarchy and behavior the same as a plain baseline so the two can be compared. Do not claim the style performs better; the choice should be validated with users.
```