AgentSidekick

Data Engineering & Analytics

Warehouses, pipelines and hands-on data analysis. As of 2026-11-21, 606 indexed products match this category (325 with full profiles); 271 were published in the last 90 days, against 113 in the 90 days before, slower than the catalogue as a whole. By GitHub stars, diagram-design leads, holding 10% of the stars of the 458 products here with their own repository. The most common form is MCP servers (83% of indexed products).

CategorySegment label: Thin DER

Segment statistics

Whole catalogue (all 606 indexed products, not only profiled ones). Calculated 2026-11-21.

606DERIndexed products325 with full profiles
271DERLaunched, last 90 days113 in the 90 days before
36DERMomentum vs catalogue50 = same pace as the catalogue
10%DERLargest project's share of starsAcross 458 products with their own repository
0.051DERConcentration (HHI)About 20 equal-sized projects’ worth; unconcentrated
5SRCMedian starsPer product with its own repository
73%DEROpen sourceMarked open source; unknown counts as not

Thin. Among the smallest 30% of nodes at its level, and launches are not outpacing the catalogue. Size is ranked against the other category nodes; momentum compares this node’s launches in the last 90 days with the 90 before, relative to the whole catalogue’s ratio (score 62 or more = faster, 38 or less = slower; below 5 dated launches it is not measured and the label uses size alone).

Concentration. The Herfindahl–Hirschman index (HHI) adds up each project’s squared share of stars. At 0.051, attention is spread as if across about 20 equally popular projects. Using the common competition-policy thresholds (0.15 and 0.25), that is unconcentrated. Stars measure attention, not usage or quality.

Which product forms serve it

The same need is met by MCP servers, agent skills, plugins, extensions and frameworks. This counts each form across the whole catalogue.

Products in Data Engineering & Analytics by product type, as of 2026-11-21
Product type IndexedShareWith a profile
MCP servers50282.8%222
Agent skills447.3%44
Plugins284.6%28
Infrastructure183.0%18
Agent projects71.2%7
IDE extensions30.50%3
Frameworks20.33%2
Rules packs10.17%0
Automation platforms10.17%1

3 subcategories

Indexed = whole catalogue; profiled = products with their own page. A product can sit in several, so the rows do not add up to the total.

SubcategoryIndexed ProfiledNew, 90 daysLabel
Data AnalysisExploring datasets, spreadsheets and notebooks.255121128Thin
Data WarehousesAnalytical warehouses and lakehouses.23814796Thin
Data PipelinesMoving and transforming data between systems.1729667Thin

Top 40 products by GitHub stars

Search the directory

Profiled products only (325 of 606), ranked by the stars of their own repository. Products that live in a subfolder of a larger repository (common for skills) show that whole repository's stars and are ranked after them; products without a repository come last. Stars are popularity, not quality or installs.

Data Engineering & Analytics: top profiled products by GitHub stars, 2026-11-21
#ProductTypePublisherCapabilities GitHub stars Last push LicenceSave and compare
1diagram-designEditorial diagram design for Claude Code, Codex, GitHub Copilot, Cursor, Factory Droid, Qoder, and Pi. 45 diagram types. Self-contained HTML + SVG. No shadows. No Mermaid slop.Agent skillcathrynlavery70k2d agoMIT
2TrendRadar⭐AI-driven public opinion & trend monitor with multi-platform aggregation, RSS, web search, MCP & smart alerts.🎯 告别信息过载,你的 AI 舆情监控助手与热点筛选工具!聚合多平台热点 + RSS 订阅 + 定时联网搜索,支持关键词与 AI 智能筛选。AI 翻译 + AI 分析简报直推手机,支持接入 MCP 架构,赋能 AI 自然语言对话分析、实时检索、情感洞察与趋势预测。支持 Docker,数据本地/云端自持。集成微信/飞书/钉钉/Telegram/邮件/ntfy/Bark/Slack 等渠道智能推送。MCP serversansan064ktodayGPL-3.0
3servietteA no-code RAG server that keeps answers in sync with your documents. Works with 8 vector databases. Built on Pathway.Infrastructurepathwaycom59k11d agoMIT
4scientific-agent-skillsTurn any AI agent into an AI Scientist. The #1 Agent Skills library for science, used by 250,000+ scientists worldwide. 177 ready-to-use validated skills plus 100+ scientific databases covering biology, chemistry, medicine, and drug discovery. Compatible with Cursor, Claude Code, Codex, Pi, Antigravity, and the open Agent Skills standard.Agent skillK-Dense-AI58k5d agoMIT
5BettaFish微舆:人人可用的多Agent舆情分析助手,打破信息茧房,还原舆情原貌,预测未来走向,辅助决策!从0实现,不依赖任何框架。Framework666ghj43k1mo agoGPL-2.0
6cliGoogle Workspace CLI — one command-line tool for Drive, Gmail, Calendar, Sheets, Docs, Chat, Admin, and more. Dynamically built from Google Discovery Service. Includes AI agent skills.Agent skillgoogleworkspace32k1d agoApache-2.0
7dbxQuery databases from AI agents using connections configured in DBX.MCP servert8y231ktodayApache-2.0
8kestraOrchestrate everything, everywhere. The open-source control plane for workflows across data, infrastructure, business processes and AI agents. Declarative YAML, event-driven, any language, Git-versioned, scalable to millions of executions.Agent projectkestra-io30k1d agoApache-2.0
9WindmillDeveloper platform that turns scripts in many languages into workflows, UIs and scheduled jobs, with AI steps and agents.Automation platformwindmill-labs19ktodayAGPL-3.0
10WrenAIGenBI (Generative BI) for AI agents, an open-source, governed text-to-SQL through an open context layer that turns natural-language questions into trusted dashboards, charts, and SQL across 20+ data sources, such as BigQuery, Snowflake, PostgreSQL, ClickHouse, Amazon Redshift, Databricks and more.Agent projectCanner18k1d ago—
11MCP Toolbox for DatabasesMCP server that exposes configured database queries as tools for agents, with connection pooling and auth for many databases.Infrastructuregoogle17ktodayApache-2.0
12MCP Toolbox for DatabasesMCP Toolbox for Databases enables your agent to connect to your database.MCP servergoogleapis17ktodayApache-2.0
13nightingaleOpen-source, self-hosted alerting for metrics, logs, and databases. Includes a built-in AI agent and MCP server.MCP serverccfos14k2d agoApache-2.0
14mcpReal-time Kubernetes network traffic visibility and API analysis for HTTP, gRPC, Redis, Kafka, DNS.MCP serverkubeshark12k11d agoApache-2.0
15cocoindexIncremental engine for long horizon agents 🌟 Star if you like it!Agent projectcocoindex-io12ktodayApache-2.0
16LagoOpen-source metering and usage-based billing engine, self-hosted or cloud.InfrastructureLago11k2d agoAGPL-3.0
17databendData Agent Ready Warehouse : One for Analytics, Search, AI, Python Sandbox. — rebuilt from scratch. Unified architecture on your S3.Infrastructuredatabendlabs9.5ktodayApache-2.0
18evidentlyEvidently is ​​an open-source ML and LLM observability framework. Evaluate, test, and monitor any AI-powered system or data pipeline. From tabular data to Gen AI. 100+ metrics.Infrastructureevidentlyai8.1k1mo agoApache-2.0
19unstractLLM-Driven Extraction of Unstructured Data — Built for API Deployments & ETL Pipeline WorkflowsMCP serverZipstack7.5k1d agoAGPL-3.0
20lieflat-chartsData visualization Skill for AI Agents, turning data into polished, interactive HTML charts. 面向 AI Agents 的数据可视化 Skill,将数据快速生成精致、可交互的 HTML 图表。Agent skilllarashero3-dotcom7.0k9d ago—
21pinotApache Pinot: a real-time analytics database for low-latency SQL and vector search, serving user-facing and agent-facing applicationsAgent projectapache6.2ktodayApache-2.0
22SenseNova-SkillsModular SenseNova skills for building AI-powered office assistants and productivity workflowsAgent skillOpenSenseNova6.1k8d agoMIT
23tabularisOpen-source desktop SQL workspace with 3 built-in database drivers and 29 shipped driver plugins, including SQL Server, DuckDB, ClickHouse and Redis. Built-in MCP server for Claude, Cursor and Devin, SQL notebooks and visual EXPLAIN.MCP serverTabularisDB5.5k1d agoApache-2.0
24JitsuManage Jitsu data pipelines: destinations, streams, connections, functions, live events.MCP serverjitsu.com5.1k1d agoMIT
25whodbWhere data access meets operational intelligenceMCP serverclidey5.1ktodayApache-2.0
26memgraphHigh-performance open-source in-memory graph database for GraphRAG, AI memory, agentic AI, and real-time graph analytics. Cypher-compatible, built in C++.Agent projectmemgraph4.7ktoday—
27daguSelf-hostable workflow orchestrator for teams whose main work isn't orchestration. Declarative YAML over your scripts, SSH commands, containers, etc; keep workflows separate from business logic. One binary, no database, runs on limited H/W resources. Alternative to Airflow / Cron / Job Scheduler.MCP serverdagucloud4.6ktodayGPL-3.0
28flint-chart🪄 Flint is a visualization language that lets AI agents reliably create expressive, good-looking charts from simple, human-editable chart specs.MCP servermicrosoft4.6k3d agoMIT
29Excel MCP ServerCreate and edit Excel files with AI: charts, PivotTables, formulas. No Excel needed.MCP serverharis-musa4.3k1d agoMIT
30pythonOpen-source Python challenge courses — your AI coding agent teaches, verify.py decides when you're done.Agent projectflypythoncom4.2k11d ago—
31lean-ctxLeanCTX is the Context Gateway for AI Systems. Select task-relevant context, apply supported controls, connect local knowledge and inspect recorded evidence. Open-source Engine: CLI, MCP, hooks and supported proxy paths.MCP serveryvgude4.0k3d agoApache-2.0
32DBHubToken-efficient MCP server for PostgreSQL, MySQL, MariaDB, SQL Server, Oracle, ClickHouse, SQLiteMCP serverbytebase3.9ktodayMIT
33google_workspace_mcpControl Gmail, Google Calendar, Docs, Sheets, Slides, Chat, Forms, Tasks, Search & Drive with AI - Comprehensive Google Workspace MCP Server & CLI ToolMCP servertaylorwilsdon3.6k1d agoMIT
34aws-data-analyticsData lake, analytics, and ETL workflows with S3 Tables, AWS Glue, and Athena.Pluginaws3.5ktodayApache-2.0
35openlitSame agent, Smaller bill. The tools and infrastructure to get more work from your AI. Fewer tokens. Less compute. Lower cost.Agent projectopenlit3.1k1d agoApache-2.0
36examplesJupyter Notebooks to help you get hands-on with Pinecone vector databasesInfrastructurepinecone-io3.0k29d agoMIT
37SemioticVerified React chart generation: select, validate, repair, render, and inspect charts through MCP.MCP servernteract2.7k1d agoApache-2.0
38hamiltonApache Hamilton helps data scientists and engineers define testable, modular, self-documenting dataflows, that encode lineage/tracing and metadata. Runs and scales everywhere python does.Infrastructureapache2.6k5d agoApache-2.0
39OpenMeterReal-time usage metering and billing for AI and API products, aggregating events into meters, entitlements and invoices.InfrastructureOpenMeter2.5ktodayApache-2.0
40portaljs🌀 AI-native framework for building data portals. Scaffold a full portal from a brief and load datasets in minutes with agentic skills — any backend (CKAN, GitHub, Frictionless).Agent skilldatopian2.4k24d agoMIT

Most common integrations

Third-party services named by products in this node, whole catalogue.

IntegrationProducts Share
Google Sheets467.6%
PostgreSQL355.8%
Microsoft Excel325.3%
Apache Kafka274.5%
BigQuery274.5%
Snowflake264.3%
MySQL193.1%
Databricks122.0%
Redis81.3%
Gmail71.2%
AWS61.0%
Azure61.0%
Elasticsearch61.0%
Google Cloud50.8%
Google Workspace50.8%

Launches per month

New Data Engineering & Analytics products per monthSRC

Whole catalogue, by publication month, 2024-11 to 2026-11. The last month is partial; undated products are excluded.

New Data Engineering & Analytics products per monthWhole catalogue, by publication month, 2024-11 to 2026-11. The last month is partial; undated products are excluded.. Products published: 23 points, latest 92 products in 2026-11.
Show the data as a table
New Data Engineering & Analytics products per month. Whole catalogue, by publication month, 2024-11 to 2026-11. The last month is partial; undated products are excluded.
Products published (products)
2024-112
2024-121
2025-021
2025-035
2025-042
2025-062
2025-073
2025-081
2025-0911
2025-108
2025-113
2025-124
2026-019
2026-0224
2026-0323
2026-0424
2026-0532
2026-0628
2026-0741
2026-0860
2026-0957
2026-1098
2026-1192

Related opportunities

Opportunity radar

Scored gaps for this node or anything beneath it. Scores rank hypotheses; they do not predict demand.

OpportunityCompetitionConfidenceScore
Coverage gap: NotebooksNotebooksHighLow61.7
Coverage gap: Data VisualizationData VisualizationHighLow56.7
Coverage gap: Data Catalogs & LineageData Catalogs & LineageHighLow52.0

Limits of these numbers

  • Products are placed here by whole-word keyword rules on their name, description and repository topics, and inherit every ancestor of a matched node. Products that do this without naming it are missed; ambiguous words cause false matches. Methodology
  • About half of the catalogue matches no node at all, so absolute counts understate every category.
  • Launch counts use the publication date each source reports; for auto-discovered repositories that is the repository’s creation date.
  • Stars and concentration cover only products with their own repository (not a subfolder of a larger one). They measure attention, not adoption.

Page data last updated .