Vercel Labs has released agent-desktop, an open-source command-line interface tool that enables AI agents to interact with desktop applications across macOS, Windows, and Linux. Unlike tools that rely on screenshots, agent-desktop accesses applications through the operating system's accessibility tree, providing agents with structured data and stable references. This approach significantly reduces token usage, with reported savings of 78% to 96% for dense applications, and allows agents to operate without interfering with the user's current session. AI
IMPACT Enables AI agents to control desktop applications more efficiently, potentially reducing costs and expanding their capabilities.
RANK_REASON Open-source release of a tool for AI agents, not a frontier model release or core research.
Read on Mastodon — mastodon.social →
- agent-desktop
- Anthropic
- Apache Software License 2.0
- Apple Maps
- AX API
- Electron
- Linux
- macOS
- Microsoft Windows
- Notion
- Slack
- UI Automation
- Vercel Labs
- Visual Studio Code
AI-generated summary · Google Gemini · from 5 sources. How we write summaries →