Testing & QA
Generating, running and maintaining automated software tests. As of 2026-11-21, 451 indexed products match this category (132 with full profiles); 229 were published in the last 90 days, against 101 in the 90 days before, slower than the catalogue as a whole. By GitHub stars, Keploy leads, holding 14% of the stars of the 348 products here with their own repository. The most common form is MCP servers (89% of indexed products).
CategorySegment label: Thin DER
Segment statistics
Whole catalogue (all 451 indexed products, not only profiled ones). Calculated 2026-11-21.
Thin. Among the smallest 30% of nodes at its level, and launches are not outpacing the catalogue. Size is ranked against the other category nodes; momentum compares this node’s launches in the last 90 days with the 90 before, relative to the whole catalogue’s ratio (score 62 or more = faster, 38 or less = slower; below 5 dated launches it is not measured and the label uses size alone).
Concentration. The Herfindahl–Hirschman index (HHI) adds up each project’s squared share of stars. At 0.093, attention is spread as if across about 11 equally popular projects. Using the common competition-policy thresholds (0.15 and 0.25), that is unconcentrated. Stars measure attention, not usage or quality.
Which product forms serve it
The same need is met by MCP servers, agent skills, plugins, extensions and frameworks. This counts each form across the whole catalogue.
| Product type | Indexed | Share | With a profile |
|---|---|---|---|
| MCP servers | 401 | 88.9% | 86 |
| Agent skills | 22 | 4.9% | 22 |
| Plugins | 16 | 3.5% | 15 |
| Rules packs | 5 | 1.1% | 2 |
| Libraries | 2 | 0.44% | 2 |
| IDE extensions | 2 | 0.44% | 2 |
| Infrastructure | 1 | 0.22% | 1 |
| Frameworks | 1 | 0.22% | 1 |
| Agent projects | 1 | 0.22% | 1 |
1 subcategories
Indexed = whole catalogue; profiled = products with their own page. A product can sit in several, so the rows do not add up to the total.
| Subcategory | Indexed | Profiled | New, 90 days | Label |
|---|---|---|---|---|
| Test AutomationCreating and running automated test suites. | 451 | 132 | 229 | Lagging the catalogue |
Top 40 products by GitHub stars
Search the directoryProfiled products only (132 of 451), ranked by the stars of their own repository. Products that live in a subfolder of a larger repository (common for skills) show that whole repository's stars and are ranked after them; products without a repository come last. Stars are popularity, not quality or installs.
| # | Product | Type | Publisher | Capabilities | GitHub stars | Last push | Licence | Save and compare |
|---|---|---|---|---|---|---|---|---|
| 1 | KeployEnd-to-end API testing — generate and run tests from OpenAPI, curl, Postman, or real user traffic. | MCP server | keploy | 20k | today | Apache-2.0 | ||
| 2 | DeepEvalPytest-style framework for evaluating LLM outputs, RAG pipelines and agents with research-backed metrics and synthetic test generation. | Library | confident-ai | 20k | 1d ago | Apache-2.0 | ||
| 3 | artemisARTEMIS turns natural-language instructions into reliable Android automation. It automates end-to-end workflows, captures logs, and integrates seamlessly with AI coding assistants such as Antigravity, Codex, and Claude Code. It also achieves 99%+ success rate on AndroidWorld Benchmark. | Agent project | 18k | 1mo ago | Apache-2.0 | |||
| 4 | docker-androidAndroid in docker solution with noVNC supported, video recording, mcp server and AI-agent | MCP server | budtmo | 16k | 2d ago | — | ||
| 5 | SeleniumBase MCPStealthy browser automation, testing, and web-scraping via CDP Mode. | MCP server | seleniumbase | 13k | today | MIT | ||
| 6 | mobile-mcpMCP server for iOS and Android Mobile Development, Automation and Testing | MCP server | mobile-next | 11k | 3d ago | Apache-2.0 | ||
| 7 | lamdaAndroid Full-Stack Device Control Platform: WebRTC/H.264 remote desktop, UI/OCR/image-matching automation, one-click MITM, built-in Frida, proxy/VPN/frp/P2P networking, MCP/Agent, 160+ APIs, designed for multi-device clusters and engineered deployments. | MCP server | firerpa | 8.8k | 6d ago | MIT | ||
| 8 | agent-deviceOpen source device layer for AI agents: control mobile, web, TV, and desktop apps over MCP | MCP server | callstack | 5.5k | today | MIT | ||
| 9 | agent-deviceLet AI agents inspect, control, and debug real iOS, Android, desktop, and TV apps | MCP server | callstackincubator | 5.5k | today | MIT | ||
| 10 | playwright-skillGeneral-purpose Playwright automation for coding agents | Agent skill | lackeyjb | 3.3k | 20d ago | MIT | ||
| 11 | ArgentDrive iOS, Android, HarmonyOS, TV, Mac and Electron/web apps from your coding agent | MCP server | software-mansion | 3.2k | today | Apache-2.0 | ||
| 12 | ux-ui-agent-skillsDesign-system skills for Claude Code, Codex, Cursor, Copilot and Gemini CLI: DTCG tokens, WCAG 2.2 AA to AAA, 2,144 design systems, 26 skills, any-framework code, and 52 gates that fail the build instead of taking the agent's word for it. | Agent skill | plugin87 | 3.2k | 3d ago | MIT | ||
| 13 | testkube-mcpMCP server for Testkube - Manage test workflows, executions, and artifacts via AI assistants | MCP server | kubeshop | 1.7k | today | — | ||
| 14 | autoprompt-skillAutoprompt is a coding-agent skill that cuts failures by 45% on agentic coding tasks. | Agent skill | Spielewoy | 1.3k | 1mo ago | MIT | ||
| 15 | simutilUtilities for Android emulators, iOS simulators and real devices: launch, stream, control, record and automate them from a desktop app, TUI and CLI | MCP server | dungngminh | 1.2k | 3d ago | MIT | ||
| 16 | dsh-vision-toolkit[dsh]为纯文本模型设计更强大的视觉工具箱:一行安装使用、粘贴图片直接识别、多张图片问答、截图到前端UI 还原等|DeepSeek Harness-native integration for agent-vision-toolkit: image Q&A, long-screenshot OCR, UI restoration, grounding, pixel diff, Artifacts, and Web UI. | Agent skill | Anionex | 949 | today | MIT | ||
| 17 | better-design🎨 Open-source design MCP server + shadcn/ui registry — AI design systems for Claude Code, Cursor, Codex, GitHub Copilot & any MCP client. 31 brand-grade themes (Linear, Stripe, Vercel, Notion, Apple, Supabase, Figma…) + design tokens, UI principles & WCAG rules. Install any component with one command. | MCP server | marvkr | 589 | 26d ago | MIT | ||
| 18 | DroidlineLet an AI agent see and use a real Android phone over Wi-Fi, without ADB or root. | MCP server | KnifeLemon | 558 | 18d ago | MIT | ||
| 19 | PrefireRender SwiftUI #Preview as PNG images, so an AI agent sees the views it changes | MCP server | BarredEwe | 535 | 8d ago | Apache-2.0 | ||
| 20 | iPhone UseDrive a real iPhone from a Mac: read the screen as text, tap, type, scroll, replay saved flows. | MCP server | leeguooooo | 512 | today | — | ||
| 21 | shaft-mcpSHAFT browser automation, capture, and offline deterministic failure diagnosis | MCP server | ShaftHQ | 421 | today | MIT | ||
| 22 | flutter-skillAI-powered E2E testing for 10 platforms. 253 MCP tools. Zero test code needed. | MCP server | ai-dashboad | 411 | 2mo ago | MIT | ||
| 23 | codspeedCodSpeed is the all-in-one performance testing toolkit. Dive into benchmarking results, flamegraphs, and performance comparisons — give Claude granular profiling context to pinpoint bottlenecks and autonomously iterate on performance via the CodSpeed MCP server. | Plugin | codspeedhq | 395 | today | Apache-2.0 | ||
| 24 | mirroir-mcpDrive a stock iPhone via iPhone Mirroring: no Developer Mode, Xcode or WDA. LLM-free skill replay. | MCP server | jfarcand | 395 | 1d ago | Apache-2.0 | ||
| 25 | Postman MCP ServerGive your AI agents trusted access to the full Postman platform. | MCP server | postman.com | 333 | 1d ago | Apache-2.0 | ||
| 26 | phonedriverMCP server and CLI that lets AI agents see and control Android phones and iPhones (iOS) as text. | MCP server | hridaya423 | 332 | today | AGPL-3.0 | ||
| 27 | claude-show-your-workClaude Code plugin to see, review and iterate on your agent's work without leaving the terminal: show images, play videos, and run visual QA with Playwright recordings and before/after comparisons inside the Claude Code terminal. Works in any terminal that supports the kitty graphics protocol, fully cross-platform on macOS, Linux and Windows. | Plugin | iamumeransari | 313 | 16d ago | MIT | ||
| 28 | qaskillsSearch, inspect, and install 400+ QA testing skills from qaskills.sh into any MCP client. | MCP server | PramodDutta | 250 | 18d ago | MIT | ||
| 29 | dembrandt-skillsSenior-level UX and design-system knowledge, packaged so your AI agent applies it automatically. | Agent skill | dembrandt | 197 | 2d ago | MIT | ||
| 30 | XRepoTest[EMNLP 2026] A multilingual benchmark for repository-level unit test generation, evaluating LLMs across 5 programming languages and real-world code under reproducible, Docker-based execution. | Infrastructure | solis-team | 168 | 2mo ago | — | ||
| 31 | Oh My AndroidAI agents see and drive the Android Emulator: screenshots, UI in dp, tap, dark mode, RTL, logcat. | MCP server | ateymoori | 163 | today | MIT | ||
| 32 | Hill-ClimbMake your coding agent prove "done". Each change is kept only if a locked test or benchmark scores it better. Claude Code and Codex skill. | Plugin | Bil0000 | 144 | 8d ago | MIT | ||
| 33 | Native DevToolsMCP server for desktop, browser (CDP), and Android automation. Screenshot, OCR, click, type. | MCP server | sh3ll3x3c | 142 | 1mo ago | MIT | ||
| 34 | Ignite UI MCP ServerUnified MCP server for Ignite UI — documentation, API, and CLI scaffolding | MCP server | IgniteUI | 138 | 2d ago | MIT | ||
| 35 | uisightYour AI sees the screen but can't measure it — measured web UI findings, shared live sessions | MCP server | yusufcemres | 130 | 2mo ago | MIT | ||
| 36 | CypressCYPRESS (Contextual Yield Protocol for Routed Expert Seed Systems) — a project- and vendor-agnostic multi-agent seed for AI coding tools. Drop it into any repo to give agents a large number of per-role expert team, named protocols, a progressive-discovery knowledge graph, and spec- and test-driven discipline by default. | Framework | llopresto87 | 129 | 10d ago | MIT | ||
| 37 | pepeLoad-test a URL, ping it by phase, ramp to find the capacity, compare runs: JSON reports, guardrails | MCP server | omarmhaimdat | 97 | 4d ago | MIT | ||
| 38 | KurloRun, write and test the API requests saved in a Kurlo workspace, the open source API client. | MCP server | kurlo.dev | 79 | today | MIT | ||
| 39 | ShadowCrawlRust MCP stealth scraper: anti-bot search/scrape with CDP fallback + HITL non-robot. | MCP server | DevsHero | 71 | 2mo ago | MIT | ||
| 40 | unslop — 7-Pillar Design Craft EngineAudit UI design, extract Design DNA, generate tokens, and create transformation blueprints. | MCP server | avivgerz-hue | 65 | 4d ago | MIT |
Most common integrations
Third-party services named by products in this node, whole catalogue.
| Integration | Products | Share |
|---|---|---|
| Android | 43 | 9.5% |
| Playwright | 24 | 5.3% |
| Xcode / iOS | 21 | 4.7% |
| Figma | 6 | 1.3% |
| GitHub | 4 | 0.9% |
| OpenAPI | 4 | 0.9% |
| Jira | 3 | 0.7% |
| Postman | 3 | 0.7% |
| Google Cloud | 2 | 0.4% |
| GraphQL | 2 | 0.4% |
| PostgreSQL | 2 | 0.4% |
| Selenium | 2 | 0.4% |
| Stripe | 2 | 0.4% |
| Apache Kafka | 1 | 0.2% |
| GitLab | 1 | 0.2% |
Launches per month
New Testing & QA products per monthSRC
Whole catalogue, by publication month, 2024-12 to 2026-11. The last month is partial; undated products are excluded.
Show the data as a table
| Products published (products) | |
|---|---|
| 2024-12 | 1 |
| 2025-01 | 1 |
| 2025-05 | 1 |
| 2025-09 | 4 |
| 2025-10 | 5 |
| 2025-11 | 4 |
| 2025-12 | 3 |
| 2026-01 | 3 |
| 2026-02 | 11 |
| 2026-03 | 22 |
| 2026-04 | 18 |
| 2026-05 | 22 |
| 2026-06 | 24 |
| 2026-07 | 36 |
| 2026-08 | 45 |
| 2026-09 | 59 |
| 2026-10 | 90 |
| 2026-11 | 70 |
Related opportunities
Opportunity radarScored gaps for this node or anything beneath it. Scores rank hypotheses; they do not predict demand.
No scored opportunity here
Capability gaps are only scored inside subcategories with at least 20 indexed products, and only the top 80 are kept. None falls under this node.
Limits of these numbers
- Products are placed here by whole-word keyword rules on their name, description and repository topics, and inherit every ancestor of a matched node. Products that do this without naming it are missed; ambiguous words cause false matches. Methodology
- About half of the catalogue matches no node at all, so absolute counts understate every category.
- Launch counts use the publication date each source reports; for auto-discovered repositories that is the repository’s creation date.
- Stars and concentration cover only products with their own repository (not a subfolder of a larger one). They measure attention, not adoption.
Page data last updated .