UI Automation
PulseAugur coverage of UI Automation — every cluster mentioning UI Automation across labs, papers, and developer communities, ranked by signal.
3 day(s) with sentiment data
-
Vercel Labs ships agent-desktop 1.2.0 with Model Context Protocol integration
Vercel Labs has released agent-desktop version 1.2.0, which integrates the Model Context Protocol (MCP) to expose CLI commands as tools. This allows agents to interact with desktop applications on macOS, Windows, and Li…
-
Vercel Labs open-sources agent-desktop for AI agent computer use · 5 sources tracked
Vercel Labs has released agent-desktop, an open-source command-line interface tool that enables AI agents to interact with desktop applications across macOS, Windows, and Linux. Unlike tools that rely on screenshots, ag…
-
Windows UIPI blocks AI agents from controlling elevated apps
A common issue for computer-use agents on Windows is their inability to interact with elevated applications like Task Manager or Registry Editor. This limitation stems from Windows' User Interface Privilege Isolation (U…
-
AI agents gain direct Windows control via UI Automation
A new approach to AI-powered desktop automation, termed Windows MCP, allows agents to interact with applications using UI Automation (UIA) instead of relying solely on screenshots and vision models. This method accesses…