Microsoft’s New ‘Computer Use’ Feature Empowers AI Agents To Seamlessly Navigate And Interact With Websites And Apps
The tech community is increasingly focused on using AI to automate processes and streamline tasks, and it keeps on working to introduce novel, innovative features that would make users' lives easier. OpenAI, with its Operator, intensified the competition in the industry by bringing ahead AI agents that can handle tasks on users' behalf. Now, Microsoft seems to be heading in the same direction as it is taking a big step with its new computer use feature in Copilot Studio this week, which is meant to allow AI agents to use websites and apps automatically.
Microsoft is taking Copilot Studio to a whole new level by introducing a new computer-use feature to let AI agents automate tasks
Tech giants are focusing more on using AI to do mundane tasks for users in order to reduce the time consumed in repetitive tasks. OpenAI, by introducing Operator, brought forward the experience of human-like interactions through its super AI agent. It looks like Microsoft is also working on making Copilot more than just an assistant and has now brought ahead a new feature in Copilot Studio that is called "computer use:" which would allow AI agents to use websites and apps just like a human would.
The reason why this is a big leap is that the tech giant is paving the way for AI agents to automate tasks even if there are no built-in integrations or APIs available. Businesses can use this feature to build agents in the Copilot Studio that are able to fill reports, log into websites, or even handle customer service tasks. By taking action on behalf of the user, the platform automatically becomes more capable.
A senior leader at Microsoft, Charles Lamanna, says that the new feature is meant to make AI agents appear like real users as they would able to click, choose, and type information just like a person would. While explaining, Lamanna stated:
This allows agents to handle tasks even when there is no API available to connect to the system directly. If a person can use the app, the agent can too.
Microsoft's new update is meant to make AI agents smarter and more reliable, especially when automating real-world tasks. Whether invoices need to be processed, market research needs to be performed, or data needs to be entered across websites, Copilot Studio can now be used to create AI agents that can handle these tasks. The feature's most interesting part is the AI agents' ability to adapt to changing interfaces, leading to more dependable automation.
Microsoft had a similar feature called Actions introduced a while back, which allowed users to let the Copilot handle tasks in the background so that they could focus on other tasks. While Action is meant for personal use, Copilot Studio's computer use feature seems to be a more advanced tool help automation on a business-level.
Deal of the Day