ETL Orchestration
Scheduling batch data jobs. As of 2026-11-21, 50 indexed products offer it (25 with full profiles), in 6 forms: 36 MCP servers, 4 Agent skills, 4 Plugins, 3 Infrastructure. 14 were published in the last 90 days, against 8 in the 90 days before. kestra has the most GitHub stars, 36% of the total across 38 products with their own repository.
CapabilitySegment label: Lagging the catalogue DER
Available as
All in the directoryProfiled products grouped by product form. Within each form: own-repository products by GitHub stars, then products in a subfolder of a larger repository (they show that repository's stars), up to 10 each.
MCP servers 36 indexed · 11 profiled
Protocol-level reach: 36 of the 45 active platforms AgentSidekick tracks document support for MCP. DER Which platforms
| # | Product | Publisher | Capabilities | GitHub stars | Last push | Save and compare |
|---|---|---|---|---|---|---|
| 1 | unstractLLM-Driven Extraction of Unstructured Data — Built for API Deployments & ETL Pipeline Workflows | Zipstack | 7.5k | 1d ago | ||
| 2 | daguSelf-hostable workflow orchestrator for teams whose main work isn't orchestration. Declarative YAML over your scripts, SSH commands, containers, etc; keep workflows separate from business logic. One binary, no database, runs on limited H/W resources. Alternative to Airflow / Cron / Job Scheduler. | dagucloud | 4.6k | today | ||
| 3 | Seal Open DataFrench public open data (data.gouv.fr) cross-referenced by commune, EPCI and department. | sealopendata.fr | 1.6k | 1d ago | ||
| 4 | mcpConnect your AI assistants to Keboola and expose your data, transformations, SQL queries, ... | keboola.com | 84 | today | ||
| 5 | dbtrailMySQL change tracking with instant row-level recovery and forensic attribution for compliance. | dbtrail.com | 73 | today | ||
| 6 | airflow-mcp-serverAn MCP server for Apache Airflow | abhishekbhakat | 33 | 1y ago | ||
| 7 | RoboSystemsThe open-source knowledge graph for finance: your ledger and 8,000+ public companies' XBRL filings | robosystems.ai | 32 | today | ||
| 8 | mq-bridge-appMove data between 15+ databases, queues and files at high throughput, without it entering context | marcomq | 28 | 1d ago | ||
| 9 | dolphin-mcp-pilotAI agent interface to Apache DolphinScheduler: 58 MCP tools for workflow orchestration & data ops. | iflytek | 25 | 4d ago | ||
| 10 | DBConvert Streams (Federated SQL)Read-only SQL across your PostgreSQL, MySQL, S3 buckets and local data files, in one query. | dbconvert.com | 24 | 2mo ago |
Agent skills 4 indexed · 4 profiled
Protocol-level reach: 26 of the 45 active platforms AgentSidekick tracks document support for the Agent Skills format. DER Which platforms
| # | Product | Publisher | Capabilities | GitHub stars | Last push | Save and compare |
|---|---|---|---|---|---|---|
| 1 | ray-dataScalable data processing for ML workloads. Streaming execution across CPU/GPU, supports Parquet/CSV/JSON/images. Integrates with Ray Train, PyTorch, TensorFlow. Scales from single machine to 100s of nodes. Use for batch inference, data preprocessing, multi-modal data loading, or distributed ETL pipelines. | Orchestra-Research | — | 1mo ago | ||
| 2 | airflow-dag-patternsBuild production Apache Airflow DAGs with best practices for operators, sensors, testing, and deployment. Use when creating data pipelines, orchestrating workflows, or scheduling batch jobs. | wshobson | — | 3d ago | ||
| 3 | data-engineerBuild scalable data pipelines, modern data warehouses, and real-time streaming architectures. Implements Apache Spark, dbt, Airflow, and cloud-native data platforms. | davila7 | — | today | ||
| 4 | data-processing-ray-dataScalable data processing for ML workloads. Streaming execution across CPU/GPU, supports Parquet/CSV/JSON/images. Integrates with Ray Train, PyTorch, TensorFlow. Scales from single machine to 100s of nodes. Use for batch inference, data preprocessing, multi-modal data loading, or distributed ETL pipelines. | davila7 | — | today |
Plugins 4 indexed · 4 profiled
4 of these are Claude plugins, which Claude Code documents (protocol-level). DER
| # | Product | Publisher | Capabilities | GitHub stars | Last push | Save and compare |
|---|---|---|---|---|---|---|
| 1 | aws-data-analyticsData lake, analytics, and ETL workflows with S3 Tables, AWS Glue, and Athena. | aws | 3.5k | today | ||
| 2 | astronomer-data-agentsData engineering for Apache Airflow and Astronomer. Author DAGs with best practices, debug pipeline failures, trace data lineage, profile tables, migrate Airflow 2 to 3, and manage local and cloud deployments. | astronomer | 462 | 1d ago | ||
| 3 | dataData engineering for Apache Airflow and Astronomer. Author DAGs with best practices, debug pipeline failures, trace data lineage, profile tables, migrate Airflow 2 to 3, and manage local and cloud deployments. | astronomer | 462 | 1d ago | ||
| 4 | data-engineeringData engineering plugin - warehouse exploration, pipeline authoring, Airflow integration | astronomer | 462 | 1d ago |
Infrastructure 3 indexed · 3 profiled
No compatibility evidence is collected for this form.
| # | Product | Publisher | Capabilities | GitHub stars | Last push | Save and compare |
|---|---|---|---|---|---|---|
| 1 | hamiltonApache Hamilton helps data scientists and engineers define testable, modular, self-documenting dataflows, that encode lineage/tracing and metadata. Runs and scales everywhere python does. | apache | 2.6k | 5d ago | ||
| 2 | OpenContractsThe open document intelligence platform for builders and hackers - DMS for the agentic world | Open-Source-Legal | 1.6k | today | ||
| 3 | NeumAINeum AI is a best-in-class framework to manage the creation and synchronization of vector embeddings at large scale. | NeumTry | 868 | 2y ago |
Agent projects 2 indexed · 2 profiled
No compatibility evidence is collected for this form.
| # | Product | Publisher | Capabilities | GitHub stars | Last push | Save and compare |
|---|---|---|---|---|---|---|
| 1 | kestraOrchestrate everything, everywhere. The open-source control plane for workflows across data, infrastructure, business processes and AI agents. Declarative YAML, event-driven, any language, Git-versioned, scalable to millions of executions. | kestra-io | 30k | 1d ago | ||
| 2 | cocoindexIncremental engine for long horizon agents 🌟 Star if you like it! | cocoindex-io | 12k | today |
Automation platforms 1 indexed · 1 profiled
No compatibility evidence is collected for this form.
| # | Product | Publisher | Capabilities | GitHub stars | Last push | Save and compare |
|---|---|---|---|---|---|---|
| 1 | WindmillDeveloper platform that turns scripts in many languages into workflows, UIs and scheduled jobs, with AI steps and agents. | windmill-labs | 19k | today |
Which platforms these forms can reach
All platformsProtocol-level: the platform documents support for the standard. No specific pairing has been tested.
MCP servers 36 indexed here
36 platforms document MCP support CUR.
ContinueOpenCodeClaude CodeCodexGemini CLIZedOpenHandsClineWarpgooseQwen CodeBolt (bolt.new)KiroAmazon Bedrock AgentCoreAmpApps in ChatGPT / Apps SDK (now ChatGPT Plugins)Augment CodeChatGPTClaude (claude.ai apps)Claude DesktopCursorDevinDevin Desktop (formerly Windsurf)Factory (Droid)Gemini (app)Gemini Enterprise Agent Platform (formerly Vertex AI / Vertex AI Agent Builder)GitHub CopilotGitHub Copilot cloud agent (formerly Copilot coding agent)Google AntigravityJetBrains AI AssistantJunieLovableMicrosoft Copilot StudioReplit AgentTabninev0
Agent skills 4 indexed here
26 platforms document Agent Skills support CUR.
OpenClawOpenCodeClaude CodeCodexGemini CLIOpenHandsWarpgooseBolt (bolt.new)KiroAmpApps in ChatGPT / Apps SDK (now ChatGPT Plugins)ChatGPTClaude (claude.ai apps)Claude DesktopCursorDevinDevin Desktop (formerly Windsurf)Factory (Droid)Gemini (app)GitHub CopilotGitHub Copilot cloud agent (formerly Copilot coding agent)Google AntigravityJunieReplit AgentTabnine
Integrations most often paired
Third-party services named by products with this capability, whole catalogue.
| Integration | Products | Share |
|---|---|---|
| MySQL | 2 | 4.0% |
| AWS | 1 | 2.0% |
| Jira | 1 | 2.0% |
| PostgreSQL | 1 | 2.0% |
| Snowflake | 1 | 2.0% |
Keywords that trigger this capability
Matched as whole words, ignoring case, in a product's name, description and repository topics.
| Keyword | Products matched |
|---|---|
| etl | 30 |
| elt | 2 |
| airflow | 14 |
| dagster | 2 |
| prefect | 1 |
| data orchestration | 1 |
Segment statistics
Whole catalogue (50 indexed products). Calculated 2026-11-21.
Lagging the catalogue. Mid-sized among capabilities, with launches growing more slowly than the catalogue’s. Size is ranked against all capabilities; momentum compares launches in the last 90 days with the 90 before, relative to the catalogue’s own ratio (62 or more = faster, 38 or less = slower; under 5 dated launches it is not measured). The HHI of 0.210 means stars are spread as if across about 5 equally popular projects — moderately concentrated by the common 0.15 / 0.25 thresholds. Stars measure attention, not usage or quality.
Limits
- Classification is by the keywords above. A product that offers this capability without using one of them is not counted; one that uses a keyword in another sense is counted wrongly. Methodology
- Platform reach is protocol-level: it says a platform documents the standard, not that any product here was tested on it. Platforms named by publishers are their own claims.
- Stars belong to repositories. Products in a subfolder of a large repository show that whole repository’s stars and are excluded from the concentration figures.
- Launch counts use each source’s publication date; for auto-discovered repositories that is the repository’s creation date.
Page data last updated .