Observed Signal · Jul 15, 2026 · Technical Release · Source: UX Collective · Impact: 2/5 · Sentiment: Neutral
Interaction Models / Conversational UX Market: AI Demands New Interaction Models for Designers
The article argues that recent multimodal AI models are changing the fundamental grammar of software interaction, shifting interfaces from task-driven, turn-taking flows to continuous, intent-driven exchanges. It highlights a research preview from Thinking Machines Lab that demonstrates real-time multimodal 'interaction models' which can listen, see, and respond across audio, video, and text while building interfaces (a generative UI) on the fly. The author outlines design implications — rebuilding mental models, new entry/navigation conventions, deliberate intervention points, and routing judgment to humans — particularly for enterprise contexts that require auditability and accountability.
Discusses design implications of new multimodal, real-time AI interaction models that affect product and UX teams; notable but not a major platform or regulatory shift.
Wichtigste Kernpunkte & Evidenz
- Thinking Machines Lab released a research preview called Interaction Models demonstrating real-time multimodal exchange (audio, video, and text) and on-the-spot interface generation.
- The article’s author, Arin Bhowmick, is Chief Design Officer at SAP.
- A paper from TCS Research, “Can LLMs Perceive Time?”, found top models estimate task duration four to seven times too high and cannot accurately report how long their own work took.
- The demo examples include generative UI creation (e.g., building a chart of Uber’s earnings and costs while continuing the conversation).
Verknüpfte Unternehmen
8 verknüpfte UnternehmenTCS (Tata Consultancy Services)
Enterprise-IT-Dienstleistungen und Softwareplattformen für Großunternehmen.
Amazon
Globale Commerce-, Cloud-, Advertising- und Abonnement-Plattform.
“Conversational interaction in software has been around for quite some time (we’ve all used Alexa, Siri, and chatbots), but only within scrip...”
Apple
Globaler Technologiekonzern mit integriertem Betriebssystem-Ökosystem, proprietärer Consumer-Hardware und einem hochskalierbaren First-Party-Advertising- und Services-Netzwerk.
“Conversational interaction in software has been around for quite some time (we’ve all used Alexa, Siri, and chatbots), but only within scrip...”
Thinking Machines Lab
Entwickelt multimodale Foundation-Modelle und eine Infrastruktur für präzises Fine-Tuning.
“While writing this article, I read that Thinking Machines Lab , an AI startup founded by Mira Murati (the former CTO of OpenAI), released a ...”
SAP
Führender deutscher Anbieter von Enterprise-Software für ERP, Finanzwesen, Beschaffung und Customer Experience (CX).
“_Arin Bhowmick_ ( @arinbhowmick ) is Chief Design Officer at SAP, based in San Francisco, California....”
Uber
Plattform für Mobilität, Lieferung, Logistik und Werbung mit integrierter Abo-Ebene für globale Endkunden und Unternehmen.
“In one clip, two people ask it to build a chart of Uber’s earnings and costs....”
Medium
Eine abonnementbasierte digitale Publishing-Plattform, die ein geschlossenes Lese- und Autoren-Ökosystem ohne Werbe-Monetarisierung orchestriert.
“Join Medium for free to get updates from this writer....”
OpenAI
Anbieter von Foundation-Modellen, der KI-Software, APIs und Abonnements für Entwickler, Unternehmen und Endverbraucher vertreibt.
“While writing this article, I read that Thinking Machines Lab , an AI startup founded by Mira Murati (the former CTO of OpenAI), released a ...”
Ontology Mapping & Concepts
Track Real-Time Market Signals & Shifts
Set up custom watchlists to receive automated, evidence-grounded executive digests whenever material signals or shifts occur across your tracked landscape.