AgentSidekick

Test Automation

Creating and running automated test suites. As of 2026-11-21, 451 indexed products match this subcategory (132 with full profiles); 229 were published in the last 90 days, against 101 in the 90 days before, slower than the catalogue as a whole. By GitHub stars, Keploy leads, holding 14% of the stars of the 348 products here with their own repository. The most common form is MCP servers (89% of indexed products).

SubcategorySegment label: Lagging the catalogue DER

Segment statistics

Whole catalogue (all 451 indexed products, not only profiled ones). Calculated 2026-11-21.

451DERIndexed products132 with full profiles
229DERLaunched, last 90 days101 in the 90 days before
34DERMomentum vs catalogue50 = same pace as the catalogue
14%DERLargest project's share of starsAcross 348 products with their own repository
0.093DERConcentration (HHI)About 11 equal-sized projects’ worth; unconcentrated
2SRCMedian starsPer product with its own repository
73%DEROpen sourceMarked open source; unknown counts as not

Lagging the catalogue. Mid-sized for its level, with launches growing more slowly than the catalogue’s. Size is ranked against the other subcategory nodes; momentum compares this node’s launches in the last 90 days with the 90 before, relative to the whole catalogue’s ratio (score 62 or more = faster, 38 or less = slower; below 5 dated launches it is not measured and the label uses size alone).

Concentration. The Herfindahl–Hirschman index (HHI) adds up each project’s squared share of stars. At 0.093, attention is spread as if across about 11 equally popular projects. Using the common competition-policy thresholds (0.15 and 0.25), that is unconcentrated. Stars measure attention, not usage or quality.

Which product forms serve it

The same need is met by MCP servers, agent skills, plugins, extensions and frameworks. This counts each form across the whole catalogue.

Products in Test Automation by product type, as of 2026-11-21
Product type IndexedShareWith a profile
MCP servers40188.9%86
Agent skills224.9%22
Plugins163.5%15
Rules packs51.1%2
Libraries20.44%2
IDE extensions20.44%2
Infrastructure10.22%1
Frameworks10.22%1
Agent projects10.22%1

7 capabilities

Indexed = whole catalogue; profiled = products with their own page. A product can sit in several, so the rows do not add up to the total.

CapabilityIndexed ProfiledNew, 90 daysLabel
Accessibility TestingChecking apps against accessibility standards.1512381Lagging the catalogue
Mobile Device TestingTesting apps on simulators, emulators and real devices.672244Outpacing the catalogue
E2E TestingDriving a real app end to end to verify user flows.602525Lagging the catalogue
Integration TestingTesting how services and APIs work together.551928Lagging the catalogue
Visual Regression TestingCatching unintended UI changes with screenshot comparison.381324Thin
Load TestingStress and performance testing under heavy traffic.23129Thin
Unit Test GenerationWriting unit tests for functions and modules.22135Thin

Top 40 products by GitHub stars

Search the directory

Profiled products only (132 of 451), ranked by the stars of their own repository. Products that live in a subfolder of a larger repository (common for skills) show that whole repository's stars and are ranked after them; products without a repository come last. Stars are popularity, not quality or installs.

Test Automation: top profiled products by GitHub stars, 2026-11-21
#ProductTypePublisherCapabilities GitHub stars Last push LicenceSave and compare
1KeployEnd-to-end API testing — generate and run tests from OpenAPI, curl, Postman, or real user traffic.MCP serverkeploy20ktodayApache-2.0
2DeepEvalPytest-style framework for evaluating LLM outputs, RAG pipelines and agents with research-backed metrics and synthetic test generation.Libraryconfident-ai20k1d agoApache-2.0
3artemisARTEMIS turns natural-language instructions into reliable Android automation. It automates end-to-end workflows, captures logs, and integrates seamlessly with AI coding assistants such as Antigravity, Codex, and Claude Code. It also achieves 99%+ success rate on AndroidWorld Benchmark.Agent projectgoogle18k1mo agoApache-2.0
4docker-androidAndroid in docker solution with noVNC supported, video recording, mcp server and AI-agentMCP serverbudtmo16k2d ago—
5SeleniumBase MCPStealthy browser automation, testing, and web-scraping via CDP Mode.MCP serverseleniumbase13ktodayMIT
6mobile-mcpMCP server for iOS and Android Mobile Development, Automation and TestingMCP servermobile-next11k3d agoApache-2.0
7lamdaAndroid Full-Stack Device Control Platform: WebRTC/H.264 remote desktop, UI/OCR/image-matching automation, one-click MITM, built-in Frida, proxy/VPN/frp/P2P networking, MCP/Agent, 160+ APIs, designed for multi-device clusters and engineered deployments.MCP serverfirerpa8.8k6d agoMIT
8agent-deviceOpen source device layer for AI agents: control mobile, web, TV, and desktop apps over MCPMCP servercallstack5.5ktodayMIT
9agent-deviceLet AI agents inspect, control, and debug real iOS, Android, desktop, and TV appsMCP servercallstackincubator5.5ktodayMIT
10playwright-skillGeneral-purpose Playwright automation for coding agentsAgent skilllackeyjb3.3k20d agoMIT
11ArgentDrive iOS, Android, HarmonyOS, TV, Mac and Electron/web apps from your coding agentMCP serversoftware-mansion3.2ktodayApache-2.0
12ux-ui-agent-skillsDesign-system skills for Claude Code, Codex, Cursor, Copilot and Gemini CLI: DTCG tokens, WCAG 2.2 AA to AAA, 2,144 design systems, 26 skills, any-framework code, and 52 gates that fail the build instead of taking the agent's word for it.Agent skillplugin873.2k3d agoMIT
13testkube-mcpMCP server for Testkube - Manage test workflows, executions, and artifacts via AI assistantsMCP serverkubeshop1.7ktoday—
14autoprompt-skillAutoprompt is a coding-agent skill that cuts failures by 45% on agentic coding tasks.Agent skillSpielewoy1.3k1mo agoMIT
15simutilUtilities for Android emulators, iOS simulators and real devices: launch, stream, control, record and automate them from a desktop app, TUI and CLIMCP serverdungngminh1.2k3d agoMIT
16dsh-vision-toolkit[dsh]为纯文本模型设计更强大的视觉工具箱:一行安装使用、粘贴图片直接识别、多张图片问答、截图到前端UI 还原等|DeepSeek Harness-native integration for agent-vision-toolkit: image Q&A, long-screenshot OCR, UI restoration, grounding, pixel diff, Artifacts, and Web UI.Agent skillAnionex949todayMIT
17better-design🎨 Open-source design MCP server + shadcn/ui registry — AI design systems for Claude Code, Cursor, Codex, GitHub Copilot & any MCP client. 31 brand-grade themes (Linear, Stripe, Vercel, Notion, Apple, Supabase, Figma…) + design tokens, UI principles & WCAG rules. Install any component with one command.MCP servermarvkr58926d agoMIT
18DroidlineLet an AI agent see and use a real Android phone over Wi-Fi, without ADB or root.MCP serverKnifeLemon55818d agoMIT
19PrefireRender SwiftUI #Preview as PNG images, so an AI agent sees the views it changesMCP serverBarredEwe5358d agoApache-2.0
20iPhone UseDrive a real iPhone from a Mac: read the screen as text, tap, type, scroll, replay saved flows.MCP serverleeguooooo512today—
21shaft-mcpSHAFT browser automation, capture, and offline deterministic failure diagnosisMCP serverShaftHQ421todayMIT
22flutter-skillAI-powered E2E testing for 10 platforms. 253 MCP tools. Zero test code needed.MCP serverai-dashboad4112mo agoMIT
23codspeedCodSpeed is the all-in-one performance testing toolkit. Dive into benchmarking results, flamegraphs, and performance comparisons — give Claude granular profiling context to pinpoint bottlenecks and autonomously iterate on performance via the CodSpeed MCP server.Plugincodspeedhq395todayApache-2.0
24mirroir-mcpDrive a stock iPhone via iPhone Mirroring: no Developer Mode, Xcode or WDA. LLM-free skill replay.MCP serverjfarcand3951d agoApache-2.0
25Postman MCP ServerGive your AI agents trusted access to the full Postman platform.MCP serverpostman.com3331d agoApache-2.0
26phonedriverMCP server and CLI that lets AI agents see and control Android phones and iPhones (iOS) as text.MCP serverhridaya423332todayAGPL-3.0
27claude-show-your-workClaude Code plugin to see, review and iterate on your agent's work without leaving the terminal: show images, play videos, and run visual QA with Playwright recordings and before/after comparisons inside the Claude Code terminal. Works in any terminal that supports the kitty graphics protocol, fully cross-platform on macOS, Linux and Windows.Pluginiamumeransari31316d agoMIT
28qaskillsSearch, inspect, and install 400+ QA testing skills from qaskills.sh into any MCP client.MCP serverPramodDutta25018d agoMIT
29dembrandt-skillsSenior-level UX and design-system knowledge, packaged so your AI agent applies it automatically.Agent skilldembrandt1972d agoMIT
30XRepoTest[EMNLP 2026] A multilingual benchmark for repository-level unit test generation, evaluating LLMs across 5 programming languages and real-world code under reproducible, Docker-based execution.Infrastructuresolis-team1682mo ago—
31Oh My AndroidAI agents see and drive the Android Emulator: screenshots, UI in dp, tap, dark mode, RTL, logcat.MCP serverateymoori163todayMIT
32Hill-ClimbMake your coding agent prove "done". Each change is kept only if a locked test or benchmark scores it better. Claude Code and Codex skill.PluginBil00001449d agoMIT
33Native DevToolsMCP server for desktop, browser (CDP), and Android automation. Screenshot, OCR, click, type.MCP serversh3ll3x3c1421mo agoMIT
34Ignite UI MCP ServerUnified MCP server for Ignite UI — documentation, API, and CLI scaffoldingMCP serverIgniteUI1382d agoMIT
35uisightYour AI sees the screen but can't measure it — measured web UI findings, shared live sessionsMCP serveryusufcemres1302mo agoMIT
36CypressCYPRESS (Contextual Yield Protocol for Routed Expert Seed Systems) — a project- and vendor-agnostic multi-agent seed for AI coding tools. Drop it into any repo to give agents a large number of per-role expert team, named protocols, a progressive-discovery knowledge graph, and spec- and test-driven discipline by default.Frameworkllopresto8712910d agoMIT
37pepeLoad-test a URL, ping it by phase, ramp to find the capacity, compare runs: JSON reports, guardrailsMCP serveromarmhaimdat974d agoMIT
38KurloRun, write and test the API requests saved in a Kurlo workspace, the open source API client.MCP serverkurlo.dev79todayMIT
39ShadowCrawlRust MCP stealth scraper: anti-bot search/scrape with CDP fallback + HITL non-robot.MCP serverDevsHero712mo agoMIT
40unslop — 7-Pillar Design Craft EngineAudit UI design, extract Design DNA, generate tokens, and create transformation blueprints.MCP serveravivgerz-hue655d agoMIT

Most common integrations

Third-party services named by products in this node, whole catalogue.

IntegrationProducts Share
Android439.5%
Playwright245.3%
Xcode / iOS214.7%
Figma61.3%
GitHub40.9%
OpenAPI40.9%
Jira30.7%
Postman30.7%
Google Cloud20.4%
GraphQL20.4%
PostgreSQL20.4%
Selenium20.4%
Stripe20.4%
Apache Kafka10.2%
GitLab10.2%

Launches per month

New Test Automation products per monthSRC

Whole catalogue, by publication month, 2024-12 to 2026-11. The last month is partial; undated products are excluded.

New Test Automation products per monthWhole catalogue, by publication month, 2024-12 to 2026-11. The last month is partial; undated products are excluded.. Products published: 18 points, latest 70 products in 2026-11.
Show the data as a table
New Test Automation products per month. Whole catalogue, by publication month, 2024-12 to 2026-11. The last month is partial; undated products are excluded.
Products published (products)
2024-121
2025-011
2025-051
2025-094
2025-105
2025-114
2025-123
2026-013
2026-0211
2026-0322
2026-0418
2026-0522
2026-0624
2026-0736
2026-0845
2026-0959
2026-1090
2026-1170

Related opportunities

Opportunity radar

Scored gaps for this node or anything beneath it. Scores rank hypotheses; they do not predict demand.

No scored opportunity here

Capability gaps are only scored inside subcategories with at least 20 indexed products, and only the top 80 are kept. None falls under this node.

Limits of these numbers

  • Products are placed here by whole-word keyword rules on their name, description and repository topics, and inherit every ancestor of a matched node. Products that do this without naming it are missed; ambiguous words cause false matches. Methodology
  • About half of the catalogue matches no node at all, so absolute counts understate every category.
  • Launch counts use the publication date each source reports; for auto-discovered repositories that is the repository’s creation date.
  • Stars and concentration cover only products with their own repository (not a subfolder of a larger one). They measure attention, not adoption.

Page data last updated .