Desktop Control
Mouse, keyboard and app control on macOS, Windows or Linux. As of 2026-11-21, 117 indexed products offer it (49 with full profiles), in 6 forms: 103 MCP servers, 6 Agent skills, 3 Frameworks, 3 Plugins. 54 were published in the last 90 days, against 25 in the 90 days before. Cua has the most GitHub stars, 38% of the total across 112 products with their own repository.
CapabilitySegment label: Lagging the catalogue DER
Available as
All in the directoryProfiled products grouped by product form. Within each form: own-repository products by GitHub stars, then products in a subfolder of a larger repository (they show that repository's stars), up to 10 each.
MCP servers 103 indexed · 35 profiled
Protocol-level reach: 36 of the 45 active platforms AgentSidekick tracks document support for MCP. DER Which platforms
| # | Product | Publisher | Capabilities | GitHub stars | Last push | Save and compare |
|---|---|---|---|---|---|---|
| 1 | Windows-MCPAn MCP Server for computer-use in Windows OS | CursorTouch | 12k | 1d ago | ||
| 2 | solidworks-automation-skillReliable AI Skill + MCP toolkit for agent-driven desktop CAD automation. | wzyn20051216 | 2.2k | today | ||
| 3 | InterceptorBrowser automation and computer use for AI agents. One CLI and MCP server for your signed-in browser, native macOS apps, and real iPhones. | Hacker-Valley-Media | 638 | 1d ago | ||
| 4 | applescript-mcpMCP server that execute applescript giving you full control of your Mac | peakmojo | 468 | 9mo ago | ||
| 5 | uMouse MCPUSB HID mouse control and voice dictation for Windows x64. Requires compatible uMouse hardware. | SonicloudTech | 441 | 21d ago | ||
| 6 | clawdcursorCross-OS desktop control for any AI agent: accessibility tree first, screenshots last. | AmrDab | 407 | 1d ago | ||
| 7 | mac_messages_mcpAn MCP server that securely interfaces with your iMessage database via the Model Context Protocol (MCP), allowing LLMs to query and analyze iMessage conversations. It includes robust phone number validation, attachment processing, contact management, group chat handling, and full support for sending and receiving messages. | carterlasalle | 345 | 3d ago | ||
| 8 | nuphus-mcpDesktop automation MCP server — computer use for any AI agent: control screen, windows, mouse/keyboard, and Chrome via Model Context Protocol (stdio). Not a DSH plugin — DSH users install dsh-nuphus-mcp. | mrpulor-gh | 335 | 9d ago | ||
| 9 | apple-mail-mcpMCP server giving AI assistants full access to Apple Mail - read, search, compose, organize & analyze emails via natural language | patrickfreyer | 261 | 3d ago | ||
| 10 | macOS-MCPMCP server for macOS desktop automation via the Accessibility API. | Jeomon | 247 | 19d ago |
Agent skills 6 indexed · 6 profiled
Protocol-level reach: 26 of the 45 active platforms AgentSidekick tracks document support for the Agent Skills format. DER Which platforms
| # | Product | Publisher | Capabilities | GitHub stars | Last push | Save and compare |
|---|---|---|---|---|---|---|
| 1 | lcuCodex computer use, decoupled from the app, for usage inside any harness. | amontlabs | 2.4k | 2d ago | ||
| 2 | agent-vision-toolkit为纯文本模型"看图“设计更好的视觉工具箱和技能,支持多图理解,图片问答,前端UI还原、GUI 自动化等,并可选无缝接入多个主流agent,直接识别粘贴图片| A vision toolkit and skill designed for text-only llms — image Q&A, long-screenshot OCR, frontend UI restoration, and GUI automation, with optional seamless integration for Codex, Claude Code, Pi, Oh My Pi, and OpenCode | Anionex | 1.3k | 1mo ago | ||
| 3 | dsh-vision-toolkit[dsh]为纯文本模型设计更强大的视觉工具箱:一行安装使用、粘贴图片直接识别、多张图片问答、截图到前端UI 还原等|DeepSeek Harness-native integration for agent-vision-toolkit: image Q&A, long-screenshot OCR, UI restoration, grounding, pixel diff, Artifacts, and Web UI. | Anionex | 949 | today | ||
| 4 | huashu-mac-use让任何 agent 操控 Mac 上没有 API 的原生 app,读后台、写不打扰、每步留取证 · Agent Skill for macOS computer use | alchaincyf | 348 | 6d ago | ||
| 5 | adobe-illustrator-integrationsBuild, debug, package, and document Adobe Illustrator integrations: CEP extension panels, C++ SDK plug-ins (.aip), the coming UXP plugins, MCP servers that drive Illustrator, computer-use automation, and OS scripts (batch, PowerShell, bash, AppleScript) that run ExtendScript in Illustrator. Use when creating or fixing an Illustrator extension or plug-in, choosing between a script, extension, or plug-in, connecting an AI tool to Illustrator, automating Illustrator from the command line, or writing install and usage docs for an Illustrator tool someone will publish. Pairs with adobe-illustrator-scripting for the ExtendScript DOM. | github | — | 1d ago | ||
| 6 | computer-use-agentsBuild AI agents that interact with computers like humans do - viewing screens, moving cursors, clicking buttons, and typing text. Covers Anthropic's Computer Use, OpenAI's Operator/CUA, and open-source alternatives. Critical focus on sandboxing, security, and handling the unique challenges of vision-based control. Use when: computer use, desktop automation agent, screen control AI, vision-based agent, GUI automation. | davila7 | — | today |
Frameworks 3 indexed · 3 profiled
No compatibility evidence is collected for this form.
| # | Product | Publisher | Capabilities | GitHub stars | Last push | Save and compare |
|---|---|---|---|---|---|---|
| 1 | OpenGUIOpenGUI is an Android GUI agent framework for phone-use AI that can see, plan, and operate real mobile apps through the GUI. | Core-Mate | 1.8k | 5d ago | ||
| 2 | crab🦀️ CRAB: Cross-environment Agent Benchmark for Multimodal Language Model Agents. https://crab.camel-ai.org/ | camel-ai | 435 | 5d ago | ||
| 3 | Abu-CoworkOpen-source AI office assistant for your desktop: describe the result or file you want in one sentence, and Abu plans and does the rest. Local-first, with Claude, OpenAI, DeepSeek and Ollama. | PM-Shawn | 424 | 8d ago |
Plugins 3 indexed · 3 profiled
3 of these are Claude plugins, which Claude Code documents (protocol-level). DER
| # | Product | Publisher | Capabilities | GitHub stars | Last push | Save and compare |
|---|---|---|---|---|---|---|
| 1 | word-format-skillClaude Code skill: replicate a reference Word (.docx) typography onto new content via HTML bridge — browser render → clipboard → Word paste. Append-mode preserves page setup / styles / theme / headers 100%. macOS only. | yeap531 | 204 | 6mo ago | ||
| 2 | automating-mac-apps-pluginAgents, Skills and Commands for automating Keynote, Notes, Reminders, Numbers and more using AppleScript and PyXA (JXA too). | SpillwaveSolutions | 49 | 3mo ago | ||
| 3 | imessageiMessage messaging bridge with built-in access control. Reads chat.db directly, sends via AppleScript. Manage pairing, allowlists, and policy via /imessage:access. | anthropics | — | today |
Agent projects 1 indexed · 1 profiled
No compatibility evidence is collected for this form.
| # | Product | Publisher | Capabilities | GitHub stars | Last push | Save and compare |
|---|---|---|---|---|---|---|
| 1 | agent-desktopComputer use CLI for AI agents | vercel-labs | 26k | today |
Infrastructure 1 indexed · 1 profiled
No compatibility evidence is collected for this form.
| # | Product | Publisher | Capabilities | GitHub stars | Last push | Save and compare |
|---|---|---|---|---|---|---|
| 1 | CuaOpen-source infrastructure for computer-use agents: sandboxed macOS, Linux and Windows VMs plus an agent SDK. | Cua | 33k | today |
Which platforms these forms can reach
All platformsProtocol-level: the platform documents support for the standard. No specific pairing has been tested.
MCP servers 103 indexed here
36 platforms document MCP support CUR.
ContinueOpenCodeClaude CodeCodexGemini CLIZedOpenHandsClineWarpgooseQwen CodeBolt (bolt.new)KiroAmazon Bedrock AgentCoreAmpApps in ChatGPT / Apps SDK (now ChatGPT Plugins)Augment CodeChatGPTClaude (claude.ai apps)Claude DesktopCursorDevinDevin Desktop (formerly Windsurf)Factory (Droid)Gemini (app)Gemini Enterprise Agent Platform (formerly Vertex AI / Vertex AI Agent Builder)GitHub CopilotGitHub Copilot cloud agent (formerly Copilot coding agent)Google AntigravityJetBrains AI AssistantJunieLovableMicrosoft Copilot StudioReplit AgentTabninev0
Agent skills 6 indexed here
26 platforms document Agent Skills support CUR.
OpenClawOpenCodeClaude CodeCodexGemini CLIOpenHandsWarpgooseBolt (bolt.new)KiroAmpApps in ChatGPT / Apps SDK (now ChatGPT Plugins)ChatGPTClaude (claude.ai apps)Claude DesktopCursorDevinDevin Desktop (formerly Windsurf)Factory (Droid)Gemini (app)GitHub CopilotGitHub Copilot cloud agent (formerly Copilot coding agent)Google AntigravityJunieReplit AgentTabnine
Platforms publishers name
| Platform | Profiled products naming it |
|---|---|
| Codex | 3 |
| Claude Code | 3 |
| OpenCode | 1 |
| Cursor | 1 |
Integrations most often paired
Third-party services named by products with this capability, whole catalogue.
| Integration | Products | Share |
|---|---|---|
| Android | 3 | 2.6% |
| Playwright | 2 | 1.7% |
| SAP | 1 | 0.9% |
| Xcode / iOS | 1 | 0.9% |
Keywords that trigger this capability
Matched as whole words, ignoring case, in a product's name, description and repository topics.
| Keyword | Products matched |
|---|---|
| desktop automation | 60 |
| mouse and keyboard | 1 |
| gui automation | 11 |
| pyautogui | 1 |
| applescript | 34 |
| macos automation | 8 |
| windows automation | 2 |
Segment statistics
Whole catalogue (117 indexed products). Calculated 2026-11-21.
Lagging the catalogue. Mid-sized among capabilities, with launches growing more slowly than the catalogue’s. Size is ranked against all capabilities; momentum compares launches in the last 90 days with the 90 before, relative to the catalogue’s own ratio (62 or more = faster, 38 or less = slower; under 5 dated launches it is not measured). The HHI of 0.259 means stars are spread as if across about 4 equally popular projects — highly concentrated by the common 0.15 / 0.25 thresholds. Stars measure attention, not usage or quality.
Limits
- Classification is by the keywords above. A product that offers this capability without using one of them is not counted; one that uses a keyword in another sense is counted wrongly. Methodology
- Platform reach is protocol-level: it says a platform documents the standard, not that any product here was tested on it. Platforms named by publishers are their own claims.
- Stars belong to repositories. Products in a subfolder of a large repository show that whole repository’s stars and are excluded from the concentration figures.
- Launch counts use each source’s publication date; for auto-discovered repositories that is the repository’s creation date.
Page data last updated .