AgentSidekick

ETL Orchestration

Scheduling batch data jobs. As of 2026-11-21, 50 indexed products offer it (25 with full profiles), in 6 forms: 36 MCP servers, 4 Agent skills, 4 Plugins, 3 Infrastructure. 14 were published in the last 90 days, against 8 in the 90 days before. kestra has the most GitHub stars, 36% of the total across 38 products with their own repository.

CapabilitySegment label: Lagging the catalogue DER

Available as

All in the directory

Profiled products grouped by product form. Within each form: own-repository products by GitHub stars, then products in a subfolder of a larger repository (they show that repository's stars), up to 10 each.

MCP servers 36 indexed · 11 profiled

Protocol-level reach: 36 of the 45 active platforms AgentSidekick tracks document support for MCP. DER Which platforms

ETL Orchestration: MCP servers by GitHub stars
#ProductPublisherCapabilities GitHub stars Last push Save and compare
1unstractLLM-Driven Extraction of Unstructured Data — Built for API Deployments & ETL Pipeline WorkflowsZipstack7.5k1d ago
2daguSelf-hostable workflow orchestrator for teams whose main work isn't orchestration. Declarative YAML over your scripts, SSH commands, containers, etc; keep workflows separate from business logic. One binary, no database, runs on limited H/W resources. Alternative to Airflow / Cron / Job Scheduler.dagucloud4.6ktoday
3Seal Open DataFrench public open data (data.gouv.fr) cross-referenced by commune, EPCI and department.sealopendata.fr1.6k1d ago
4mcpConnect your AI assistants to Keboola and expose your data, transformations, SQL queries, ...keboola.com84today
5dbtrailMySQL change tracking with instant row-level recovery and forensic attribution for compliance.dbtrail.com73today
6airflow-mcp-serverAn MCP server for Apache Airflow abhishekbhakat331y ago
7RoboSystemsThe open-source knowledge graph for finance: your ledger and 8,000+ public companies' XBRL filingsrobosystems.ai32today
8mq-bridge-appMove data between 15+ databases, queues and files at high throughput, without it entering contextmarcomq281d ago
9dolphin-mcp-pilotAI agent interface to Apache DolphinScheduler: 58 MCP tools for workflow orchestration & data ops.iflytek254d ago
10DBConvert Streams (Federated SQL)Read-only SQL across your PostgreSQL, MySQL, S3 buckets and local data files, in one query.dbconvert.com242mo ago

All 11 profiled MCP servers with this capability

Agent skills 4 indexed · 4 profiled

Protocol-level reach: 26 of the 45 active platforms AgentSidekick tracks document support for the Agent Skills format. DER Which platforms

ETL Orchestration: Agent skills by GitHub stars
#ProductPublisherCapabilities GitHub stars Last push Save and compare
1ray-dataScalable data processing for ML workloads. Streaming execution across CPU/GPU, supports Parquet/CSV/JSON/images. Integrates with Ray Train, PyTorch, TensorFlow. Scales from single machine to 100s of nodes. Use for batch inference, data preprocessing, multi-modal data loading, or distributed ETL pipelines.Orchestra-Research—1mo ago
2airflow-dag-patternsBuild production Apache Airflow DAGs with best practices for operators, sensors, testing, and deployment. Use when creating data pipelines, orchestrating workflows, or scheduling batch jobs.wshobson—3d ago
3data-engineerBuild scalable data pipelines, modern data warehouses, and real-time streaming architectures. Implements Apache Spark, dbt, Airflow, and cloud-native data platforms.davila7—today
4data-processing-ray-dataScalable data processing for ML workloads. Streaming execution across CPU/GPU, supports Parquet/CSV/JSON/images. Integrates with Ray Train, PyTorch, TensorFlow. Scales from single machine to 100s of nodes. Use for batch inference, data preprocessing, multi-modal data loading, or distributed ETL pipelines.davila7—today

Plugins 4 indexed · 4 profiled

4 of these are Claude plugins, which Claude Code documents (protocol-level). DER

ETL Orchestration: Plugins by GitHub stars
#ProductPublisherCapabilities GitHub stars Last push Save and compare
1aws-data-analyticsData lake, analytics, and ETL workflows with S3 Tables, AWS Glue, and Athena.aws3.5ktoday
2astronomer-data-agentsData engineering for Apache Airflow and Astronomer. Author DAGs with best practices, debug pipeline failures, trace data lineage, profile tables, migrate Airflow 2 to 3, and manage local and cloud deployments.astronomer4621d ago
3dataData engineering for Apache Airflow and Astronomer. Author DAGs with best practices, debug pipeline failures, trace data lineage, profile tables, migrate Airflow 2 to 3, and manage local and cloud deployments.astronomer4621d ago
4data-engineeringData engineering plugin - warehouse exploration, pipeline authoring, Airflow integrationastronomer4621d ago

Infrastructure 3 indexed · 3 profiled

No compatibility evidence is collected for this form.

ETL Orchestration: Infrastructure by GitHub stars
#ProductPublisherCapabilities GitHub stars Last push Save and compare
1hamiltonApache Hamilton helps data scientists and engineers define testable, modular, self-documenting dataflows, that encode lineage/tracing and metadata. Runs and scales everywhere python does.apache2.6k5d ago
2OpenContractsThe open document intelligence platform for builders and hackers - DMS for the agentic worldOpen-Source-Legal1.6ktoday
3NeumAINeum AI is a best-in-class framework to manage the creation and synchronization of vector embeddings at large scale.NeumTry8682y ago

Agent projects 2 indexed · 2 profiled

No compatibility evidence is collected for this form.

ETL Orchestration: Agent projects by GitHub stars
#ProductPublisherCapabilities GitHub stars Last push Save and compare
1kestraOrchestrate everything, everywhere. The open-source control plane for workflows across data, infrastructure, business processes and AI agents. Declarative YAML, event-driven, any language, Git-versioned, scalable to millions of executions.kestra-io30k1d ago
2cocoindexIncremental engine for long horizon agents 🌟 Star if you like it!cocoindex-io12ktoday

Automation platforms 1 indexed · 1 profiled

No compatibility evidence is collected for this form.

ETL Orchestration: Automation platforms by GitHub stars
#ProductPublisherCapabilities GitHub stars Last push Save and compare
1WindmillDeveloper platform that turns scripts in many languages into workflows, UIs and scheduled jobs, with AI steps and agents.windmill-labs19ktoday

Which platforms these forms can reach

All platforms

Protocol-level: the platform documents support for the standard. No specific pairing has been tested.

Integrations most often paired

Third-party services named by products with this capability, whole catalogue.

IntegrationProducts Share
MySQL24.0%
AWS12.0%
Jira12.0%
PostgreSQL12.0%
Snowflake12.0%

Keywords that trigger this capability

Matched as whole words, ignoring case, in a product's name, description and repository topics.

KeywordProducts matched
etl30
elt2
airflow14
dagster2
prefect1
data orchestration1

Segment statistics

Whole catalogue (50 indexed products). Calculated 2026-11-21.

50DERIndexed products25 with full profiles
14DERLaunched, last 90 days8 in the 90 days before
22DERMomentum vs catalogue50 = same pace as the catalogue
36%DERLargest project's share of starsAcross 38 products with their own repository
0.210DERConcentration (HHI)About 5 equal-sized projects’ worth; moderately concentrated
19SRCMedian starsPer product with its own repository
86%DEROpen sourceMarked open source; unknown counts as not

Lagging the catalogue. Mid-sized among capabilities, with launches growing more slowly than the catalogue’s. Size is ranked against all capabilities; momentum compares launches in the last 90 days with the 90 before, relative to the catalogue’s own ratio (62 or more = faster, 38 or less = slower; under 5 dated launches it is not measured). The HHI of 0.210 means stars are spread as if across about 5 equally popular projects — moderately concentrated by the common 0.15 / 0.25 thresholds. Stars measure attention, not usage or quality.

Limits

  • Classification is by the keywords above. A product that offers this capability without using one of them is not counted; one that uses a keyword in another sense is counted wrongly. Methodology
  • Platform reach is protocol-level: it says a platform documents the standard, not that any product here was tested on it. Platforms named by publishers are their own claims.
  • Stars belong to repositories. Products in a subfolder of a large repository show that whole repository’s stars and are excluded from the concentration figures.
  • Launch counts use each source’s publication date; for auto-discovered repositories that is the repository’s creation date.

Page data last updated .