uxdesign.cc
AI is reshaping UIhave you noticed the biggest changeyet?AI is reshaping interactions as we know them, driving a new UI paradigm. Lets break downhow.Goodbye commands, hellointentThe way we interact with software is anything but static. Sometimes its a gentle evolution, other times a jarring leap. Today, a growing wave of design pioneers, including Vitaly Friedman, Emily Campbell and Greg Nudelman are dissecting emerging patterns within AI applications, mapping out the landscape that refuses to stand still. At first glance, this might seem like yet another hype cycle, the kind of breathless enthusiasm that surrounds every new tech trend. But take a step back, and a deeper transformation becomes apparent: our interactions with digital systems are not just changing; they are shifting in their veryessence.Imagine the transition from film cameras to digital photographysuddenly, users no longer had to understand exposure times or carefully ration film. They simply clicked a button, and the device handled therest.AI is bringing a similar shift to UI design, moving us away from rigid, step-by-step processes and toward fluid, intuitive workflows. The very nature of the interaction is shifting, and as Jakob Nielsen recently stressed in his article, this evolution demands our full attention. He articulates a crucialinsight:With the new AI systems, the user no longer tells the computer what to do. Rather, the user tells the computer what outcome theywant.This isnt just a technological evolutionits a philosophical one. It challenges long-held assumptions about control, agency, and human-machine collaboration. Where once we meticulously dictated every step, we now define intentions and let AI determine the best path forward. This transformation is as profound as the move from command-line interfaces to graphical user interfaces, and for UI designers, it represents both an opportunity and a challenge.Tapping, swiping, asking: How interaction isevolvingBut before we dive into how AI is reshaping interaction, its important to reflect on what has defined our most intuitive interfaces so far. In 1985, Edwin Hutchins, James Hollan, and Don Norman published a seminal paper on direct manipulation interfaces. Norman later defined some of the most widely accepted design principles in The Design of Everyday Things, while Hutchins pioneered the concept of Distributed Cognition. But in 1985, they, along with Hollan, captured a pivotal moment in design history when direct manipulation was emerging as a dominant strategy.Direct manipulation is an interaction style in which users act on displayed objects of interest using physical, incremental, and reversible actions whose effects are immediately visible on the screen.NN/gBut what does this mean in simple terms? Say, you need to move a file from one folder to anotherthis is a classic example of direct manipulationyou see the file, grab it, and move it exactly where you want it togo.You start by recognizing your goal (1). Then, you locate the file in its current folder and decide to drag it to the new location (2). You click and hold the file, move it across the screen, and drop it into the target folder(3).If you accidentally drop it in the wrong place, you immediately see the result, adjust your approach, and drag it again until it lands where you intended. This kind of interaction feels intuitive because it minimizes cognitive effortthe system responds in real-time to your actions, reinforcing a sense of direct engagement andcontrol.The smoother this process, the more natural and satisfying the interaction feels.Moving a file on MacOS using direct manipulation involves dragging that file from the source folder and moving it into the destination folder.SourceWhile reducing distance improves usability, what truly defines direct manipulation is engagement. The authorswrite:The systems that best exemplify direct manipulation all give the qualitative feeling that one is directly engaged with control of the objectsnot with the programs, not with the computer, but with the semantic objects of our goals and intentions.Direct manipulation has remained a foundational design principle for decades. However, as we transition into AI-driven systems, we must consider how these principles evolveand when they give way to goal-oriented interactions.Now, think of Windows Photos AI-powered Erase feature. Say you take a picture of your dog, but theres an unwanted leash in the shot. Instead of manually selecting pixels and meticulously editing them out, as you would have done a decade ago, you simply select the leash and let the AI handle the rest. The system understands your goalremove the leashand executes the best possible solution.Windows Photos,sourceThis interaction still involves some level of manipulation, as you must indicate the object to be erased, but the difference is that you are refining a request rather than directly altering pixels. You are no longer meticulously editing every detail; you are collaborating with the system to achieve a desired outcome. This shift marks a fundamental evolution in UIdesign.Desolda, along with fellow researchers, captured this dynamic in a model based on Normans Gulf of Execution and Gulf of Evaluation. Unlike straightforward direct manipulationsuch as dragging a file between folders, where actions unfold step by stepAI interactions demand a more fluid, iterative process. Users articulate their goals, but instead of executing every step manually, they collaborate with the system, refining inputs and guiding the AI as it interprets, adjusts, and responds dynamically.SourceThe continued relevance of direct manipulationAI may be reshaping the way we interact with technology, but direct manipulation isnt going anywhere. Even in an era of intent-based interfaces, users will still need to engage with AI systems, guiding them with the right inputs to translate human goals into machine-readable instructions. Designing AI experiences isnt about replacing direct manipulationits about enhancing it, layering new interaction models on top of well-established patterns to make interactions smoother, more intuitive, and ultimately, more powerful.To design seamless AI experiences, we need to recognize and build on familiar patterns.For instance, in many AI applications, an open-ended prompt field acts as an icebreaker, helping users get the conversation started. Built upon the familiar input field pattern, which has been a standard UI component for decades, this method now serves a new role. Whether its typing a question into ChatGPT or instructing a design tool to generate a layout, this approach provides flexibility while guiding user intent in an intuitive and approachable way.Open input pattern examples, SourceThis approach isnt limited to interaction patternsit extends into UX frameworks aswell.For example, Evan Sunwall introduced Promptframes as a way to complement traditional wireframes by integrating prompt writing and generative AI into the design process. The goal is to increase content fidelity and accelerate user testing by incorporating AI-powered content generation earlier in the workflow. Yet, this concept is built upon the foundation of wireframes, reinforcing the importance of understanding traditional UX structures to effectively design for AI-driven experiences.Final thoughtsThe best interface experiences are the ones users dont notice. They dont demand your attention or make you think about how to use themthey just work, letting users focus on what they came to do. AI, when done right, follows this same principle. It doesnt need neon powered by AI labels; it should weave itself so seamlessly into the user journey that it feels like a natural extension ofintent.Take Netflixs recommender system. It doesnt interrupt your experience to remind you its using advanced algorithms. It doesnt ask you to configure a dozen settings. Instead, it quietly learns, adapts, and presents suggestions that feel effortlessso much so that you rarely stop to think about the system behind it. Thats what AI-driven interaction should be: not a feature you have to wrestle with, but an invisible assistant that refines itself around yourneeds.As we move toward intent-driven systems, this is the bar designers should aim for. AI should reduce friction, not add complexity. It should empower users, not overwhelm them with unnecessary choices. The best AI isnt the one that demands attentionits the one that disappears into the flow of what you were trying to accomplish in the firstplace.AI is reshaping UIhave you noticed the biggest change yet? was originally published in UX Collective on Medium, where people are continuing the conversation by highlighting and responding to this story.
