Vercel Labs has open-sourced agent-desktop, allowing AI agents to control desktop applications via the accessibility tree.
Vercel Labs has open-sourced agent-desktop 1.0.2, an Apache-2.0 licensed Rust command-line tool and C library that enables coding agents capable of invoking shells to read and operate native applications on macOS, Windows, and Linux through the operating system's accessibility tree, rather than relying on screenshots and visual models.
Return to original text
A short introduction is retained here; the full text from the source website is not reposted. For specific wording and subsequent updates, please refer to the original article.
Open AIHOT original