Data Engineering & Analytics
Warehouses, pipelines and hands-on data analysis. As of 2026-11-21, 606 indexed products match this category (325 with full profiles); 271 were published in the last 90 days, against 113 in the 90 days before, slower than the catalogue as a whole. By GitHub stars, diagram-design leads, holding 10% of the stars of the 458 products here with their own repository. The most common form is MCP servers (83% of indexed products).
CategorySegment label: Thin DER
Segment statistics
Whole catalogue (all 606 indexed products, not only profiled ones). Calculated 2026-11-21.
Thin. Among the smallest 30% of nodes at its level, and launches are not outpacing the catalogue. Size is ranked against the other category nodes; momentum compares this node’s launches in the last 90 days with the 90 before, relative to the whole catalogue’s ratio (score 62 or more = faster, 38 or less = slower; below 5 dated launches it is not measured and the label uses size alone).
Concentration. The Herfindahl–Hirschman index (HHI) adds up each project’s squared share of stars. At 0.051, attention is spread as if across about 20 equally popular projects. Using the common competition-policy thresholds (0.15 and 0.25), that is unconcentrated. Stars measure attention, not usage or quality.
Which product forms serve it
The same need is met by MCP servers, agent skills, plugins, extensions and frameworks. This counts each form across the whole catalogue.
| Product type | Indexed | Share | With a profile |
|---|---|---|---|
| MCP servers | 502 | 82.8% | 222 |
| Agent skills | 44 | 7.3% | 44 |
| Plugins | 28 | 4.6% | 28 |
| Infrastructure | 18 | 3.0% | 18 |
| Agent projects | 7 | 1.2% | 7 |
| IDE extensions | 3 | 0.50% | 3 |
| Frameworks | 2 | 0.33% | 2 |
| Rules packs | 1 | 0.17% | 0 |
| Automation platforms | 1 | 0.17% | 1 |
3 subcategories
Indexed = whole catalogue; profiled = products with their own page. A product can sit in several, so the rows do not add up to the total.
| Subcategory | Indexed | Profiled | New, 90 days | Label |
|---|---|---|---|---|
| Data AnalysisExploring datasets, spreadsheets and notebooks. | 255 | 121 | 128 | Thin |
| Data WarehousesAnalytical warehouses and lakehouses. | 238 | 147 | 96 | Thin |
| Data PipelinesMoving and transforming data between systems. | 172 | 96 | 67 | Thin |
Top 40 products by GitHub stars
Search the directoryProfiled products only (325 of 606), ranked by the stars of their own repository. Products that live in a subfolder of a larger repository (common for skills) show that whole repository's stars and are ranked after them; products without a repository come last. Stars are popularity, not quality or installs.
| # | Product | Type | Publisher | Capabilities | GitHub stars | Last push | Licence | Save and compare |
|---|---|---|---|---|---|---|---|---|
| 1 | diagram-designEditorial diagram design for Claude Code, Codex, GitHub Copilot, Cursor, Factory Droid, Qoder, and Pi. 45 diagram types. Self-contained HTML + SVG. No shadows. No Mermaid slop. | Agent skill | cathrynlavery | 70k | 2d ago | MIT | ||
| 2 | TrendRadar⭐AI-driven public opinion & trend monitor with multi-platform aggregation, RSS, web search, MCP & smart alerts.🎯 告别信息过载,你的 AI 舆情监控助手与热点筛选工具!聚合多平台热点 + RSS 订阅 + 定时联网搜索,支持关键词与 AI 智能筛选。AI 翻译 + AI 分析简报直推手机,支持接入 MCP 架构,赋能 AI 自然语言对话分析、实时检索、情感洞察与趋势预测。支持 Docker,数据本地/云端自持。集成微信/飞书/钉钉/Telegram/邮件/ntfy/Bark/Slack 等渠道智能推送。 | MCP server | sansan0 | 64k | today | GPL-3.0 | ||
| 3 | servietteA no-code RAG server that keeps answers in sync with your documents. Works with 8 vector databases. Built on Pathway. | Infrastructure | pathwaycom | 59k | 11d ago | MIT | ||
| 4 | scientific-agent-skillsTurn any AI agent into an AI Scientist. The #1 Agent Skills library for science, used by 250,000+ scientists worldwide. 177 ready-to-use validated skills plus 100+ scientific databases covering biology, chemistry, medicine, and drug discovery. Compatible with Cursor, Claude Code, Codex, Pi, Antigravity, and the open Agent Skills standard. | Agent skill | K-Dense-AI | 58k | 5d ago | MIT | ||
| 5 | BettaFish微舆:人人可用的多Agent舆情分析助手,打破信息茧房,还原舆情原貌,预测未来走向,辅助决策!从0实现,不依赖任何框架。 | Framework | 666ghj | 43k | 1mo ago | GPL-2.0 | ||
| 6 | cliGoogle Workspace CLI — one command-line tool for Drive, Gmail, Calendar, Sheets, Docs, Chat, Admin, and more. Dynamically built from Google Discovery Service. Includes AI agent skills. | Agent skill | googleworkspace | 32k | 1d ago | Apache-2.0 | ||
| 7 | dbxQuery databases from AI agents using connections configured in DBX. | MCP server | t8y2 | 31k | today | Apache-2.0 | ||
| 8 | kestraOrchestrate everything, everywhere. The open-source control plane for workflows across data, infrastructure, business processes and AI agents. Declarative YAML, event-driven, any language, Git-versioned, scalable to millions of executions. | Agent project | kestra-io | 30k | 1d ago | Apache-2.0 | ||
| 9 | WindmillDeveloper platform that turns scripts in many languages into workflows, UIs and scheduled jobs, with AI steps and agents. | Automation platform | windmill-labs | 19k | today | AGPL-3.0 | ||
| 10 | WrenAIGenBI (Generative BI) for AI agents, an open-source, governed text-to-SQL through an open context layer that turns natural-language questions into trusted dashboards, charts, and SQL across 20+ data sources, such as BigQuery, Snowflake, PostgreSQL, ClickHouse, Amazon Redshift, Databricks and more. | Agent project | Canner | 18k | 1d ago | — | ||
| 11 | MCP Toolbox for DatabasesMCP server that exposes configured database queries as tools for agents, with connection pooling and auth for many databases. | Infrastructure | 17k | today | Apache-2.0 | |||
| 12 | MCP Toolbox for DatabasesMCP Toolbox for Databases enables your agent to connect to your database. | MCP server | googleapis | 17k | today | Apache-2.0 | ||
| 13 | nightingaleOpen-source, self-hosted alerting for metrics, logs, and databases. Includes a built-in AI agent and MCP server. | MCP server | ccfos | 14k | 2d ago | Apache-2.0 | ||
| 14 | mcpReal-time Kubernetes network traffic visibility and API analysis for HTTP, gRPC, Redis, Kafka, DNS. | MCP server | kubeshark | 12k | 11d ago | Apache-2.0 | ||
| 15 | cocoindexIncremental engine for long horizon agents 🌟 Star if you like it! | Agent project | cocoindex-io | 12k | today | Apache-2.0 | ||
| 16 | LagoOpen-source metering and usage-based billing engine, self-hosted or cloud. | Infrastructure | Lago | 11k | 2d ago | AGPL-3.0 | ||
| 17 | databendData Agent Ready Warehouse : One for Analytics, Search, AI, Python Sandbox. — rebuilt from scratch. Unified architecture on your S3. | Infrastructure | databendlabs | 9.5k | today | Apache-2.0 | ||
| 18 | evidentlyEvidently is an open-source ML and LLM observability framework. Evaluate, test, and monitor any AI-powered system or data pipeline. From tabular data to Gen AI. 100+ metrics. | Infrastructure | evidentlyai | 8.1k | 1mo ago | Apache-2.0 | ||
| 19 | unstractLLM-Driven Extraction of Unstructured Data — Built for API Deployments & ETL Pipeline Workflows | MCP server | Zipstack | 7.5k | 1d ago | AGPL-3.0 | ||
| 20 | lieflat-chartsData visualization Skill for AI Agents, turning data into polished, interactive HTML charts. 面向 AI Agents 的数据可视化 Skill,将数据快速生成精致、可交互的 HTML 图表。 | Agent skill | larashero3-dotcom | 7.0k | 9d ago | — | ||
| 21 | pinotApache Pinot: a real-time analytics database for low-latency SQL and vector search, serving user-facing and agent-facing applications | Agent project | apache | 6.2k | today | Apache-2.0 | ||
| 22 | SenseNova-SkillsModular SenseNova skills for building AI-powered office assistants and productivity workflows | Agent skill | OpenSenseNova | 6.1k | 8d ago | MIT | ||
| 23 | tabularisOpen-source desktop SQL workspace with 3 built-in database drivers and 29 shipped driver plugins, including SQL Server, DuckDB, ClickHouse and Redis. Built-in MCP server for Claude, Cursor and Devin, SQL notebooks and visual EXPLAIN. | MCP server | TabularisDB | 5.5k | 1d ago | Apache-2.0 | ||
| 24 | JitsuManage Jitsu data pipelines: destinations, streams, connections, functions, live events. | MCP server | jitsu.com | 5.1k | 1d ago | MIT | ||
| 25 | whodbWhere data access meets operational intelligence | MCP server | clidey | 5.1k | today | Apache-2.0 | ||
| 26 | memgraphHigh-performance open-source in-memory graph database for GraphRAG, AI memory, agentic AI, and real-time graph analytics. Cypher-compatible, built in C++. | Agent project | memgraph | 4.7k | today | — | ||
| 27 | daguSelf-hostable workflow orchestrator for teams whose main work isn't orchestration. Declarative YAML over your scripts, SSH commands, containers, etc; keep workflows separate from business logic. One binary, no database, runs on limited H/W resources. Alternative to Airflow / Cron / Job Scheduler. | MCP server | dagucloud | 4.6k | today | GPL-3.0 | ||
| 28 | flint-chart🪄 Flint is a visualization language that lets AI agents reliably create expressive, good-looking charts from simple, human-editable chart specs. | MCP server | microsoft | 4.6k | 3d ago | MIT | ||
| 29 | Excel MCP ServerCreate and edit Excel files with AI: charts, PivotTables, formulas. No Excel needed. | MCP server | haris-musa | 4.3k | 1d ago | MIT | ||
| 30 | pythonOpen-source Python challenge courses — your AI coding agent teaches, verify.py decides when you're done. | Agent project | flypythoncom | 4.2k | 11d ago | — | ||
| 31 | lean-ctxLeanCTX is the Context Gateway for AI Systems. Select task-relevant context, apply supported controls, connect local knowledge and inspect recorded evidence. Open-source Engine: CLI, MCP, hooks and supported proxy paths. | MCP server | yvgude | 4.0k | 3d ago | Apache-2.0 | ||
| 32 | DBHubToken-efficient MCP server for PostgreSQL, MySQL, MariaDB, SQL Server, Oracle, ClickHouse, SQLite | MCP server | bytebase | 3.9k | today | MIT | ||
| 33 | google_workspace_mcpControl Gmail, Google Calendar, Docs, Sheets, Slides, Chat, Forms, Tasks, Search & Drive with AI - Comprehensive Google Workspace MCP Server & CLI Tool | MCP server | taylorwilsdon | 3.6k | 1d ago | MIT | ||
| 34 | aws-data-analyticsData lake, analytics, and ETL workflows with S3 Tables, AWS Glue, and Athena. | Plugin | aws | 3.5k | today | Apache-2.0 | ||
| 35 | openlitSame agent, Smaller bill. The tools and infrastructure to get more work from your AI. Fewer tokens. Less compute. Lower cost. | Agent project | openlit | 3.1k | 1d ago | Apache-2.0 | ||
| 36 | examplesJupyter Notebooks to help you get hands-on with Pinecone vector databases | Infrastructure | pinecone-io | 3.0k | 29d ago | MIT | ||
| 37 | SemioticVerified React chart generation: select, validate, repair, render, and inspect charts through MCP. | MCP server | nteract | 2.7k | 1d ago | Apache-2.0 | ||
| 38 | hamiltonApache Hamilton helps data scientists and engineers define testable, modular, self-documenting dataflows, that encode lineage/tracing and metadata. Runs and scales everywhere python does. | Infrastructure | apache | 2.6k | 5d ago | Apache-2.0 | ||
| 39 | OpenMeterReal-time usage metering and billing for AI and API products, aggregating events into meters, entitlements and invoices. | Infrastructure | OpenMeter | 2.5k | today | Apache-2.0 | ||
| 40 | portaljs🌀 AI-native framework for building data portals. Scaffold a full portal from a brief and load datasets in minutes with agentic skills — any backend (CKAN, GitHub, Frictionless). | Agent skill | datopian | 2.4k | 24d ago | MIT |
Most common integrations
Third-party services named by products in this node, whole catalogue.
| Integration | Products | Share |
|---|---|---|
| Google Sheets | 46 | 7.6% |
| PostgreSQL | 35 | 5.8% |
| Microsoft Excel | 32 | 5.3% |
| Apache Kafka | 27 | 4.5% |
| BigQuery | 27 | 4.5% |
| Snowflake | 26 | 4.3% |
| MySQL | 19 | 3.1% |
| Databricks | 12 | 2.0% |
| Redis | 8 | 1.3% |
| Gmail | 7 | 1.2% |
| AWS | 6 | 1.0% |
| Azure | 6 | 1.0% |
| Elasticsearch | 6 | 1.0% |
| Google Cloud | 5 | 0.8% |
| Google Workspace | 5 | 0.8% |
Launches per month
New Data Engineering & Analytics products per monthSRC
Whole catalogue, by publication month, 2024-11 to 2026-11. The last month is partial; undated products are excluded.
Show the data as a table
| Products published (products) | |
|---|---|
| 2024-11 | 2 |
| 2024-12 | 1 |
| 2025-02 | 1 |
| 2025-03 | 5 |
| 2025-04 | 2 |
| 2025-06 | 2 |
| 2025-07 | 3 |
| 2025-08 | 1 |
| 2025-09 | 11 |
| 2025-10 | 8 |
| 2025-11 | 3 |
| 2025-12 | 4 |
| 2026-01 | 9 |
| 2026-02 | 24 |
| 2026-03 | 23 |
| 2026-04 | 24 |
| 2026-05 | 32 |
| 2026-06 | 28 |
| 2026-07 | 41 |
| 2026-08 | 60 |
| 2026-09 | 57 |
| 2026-10 | 98 |
| 2026-11 | 92 |
Related opportunities
Opportunity radarScored gaps for this node or anything beneath it. Scores rank hypotheses; they do not predict demand.
| Opportunity | Competition | Confidence | Score |
|---|---|---|---|
| Coverage gap: NotebooksNotebooks | High | Low | 61.7 |
| Coverage gap: Data VisualizationData Visualization | High | Low | 56.7 |
| Coverage gap: Data Catalogs & LineageData Catalogs & Lineage | High | Low | 52.0 |
Limits of these numbers
- Products are placed here by whole-word keyword rules on their name, description and repository topics, and inherit every ancestor of a matched node. Products that do this without naming it are missed; ambiguous words cause false matches. Methodology
- About half of the catalogue matches no node at all, so absolute counts understate every category.
- Launch counts use the publication date each source reports; for auto-discovered repositories that is the repository’s creation date.
- Stars and concentration cover only products with their own repository (not a subfolder of a larger one). They measure attention, not adoption.
Page data last updated .