Tracing
Following each step and tool call of an agent run. As of 2026-11-21, 177 indexed products offer it (106 with full profiles), in 11 forms: 99 MCP servers, 39 Infrastructure, 11 Agent skills, 9 Plugins. 60 were published in the last 90 days, against 30 in the 90 days before. Langfuse has the most GitHub stars, 14% of the total across 145 products with their own repository.
CapabilitySegment label: Lagging the catalogue DER
Available as
All in the directoryProfiled products grouped by product form. Within each form: own-repository products by GitHub stars, then products in a subfolder of a larger repository (they show that repository's stars), up to 10 each.
MCP servers 99 indexed · 30 profiled
Protocol-level reach: 36 of the 45 active platforms AgentSidekick tracks document support for MCP. DER Which platforms
| # | Product | Publisher | Capabilities | GitHub stars | Last push | Save and compare |
|---|---|---|---|---|---|---|
| 1 | inspectorTesting and evaluation platform to chat, inspect, and debug MCP servers, MCP apps, and ChatGPT apps. | MCPJam | 2.3k | today | ||
| 2 | trpc-agent-goA Go framework for building production agent systems with graph workflows, tools, memory, A2A, AG-UI, MCP, evaluation, and observability. | trpc-group | 1.9k | today | ||
| 3 | SuperlogOpen-source agent that observes and fixes your application. Query logs, traces, metrics, incidents. | superlog.sh | 1.5k | 2d ago | ||
| 4 | orcareplayRead, replay and fork recorded coding-agent runs. | Continuum-AI-Corp | 1.1k | 1mo ago | ||
| 5 | crucible3D engine that AI agents drive | codepawl | 844 | today | ||
| 6 | ratelThe self-improvement layer for AI agents. Ratel reads your agent's traces, finds what fails, recommends fixes and runs evals on real sessions before you ship. Self-hosted: one app, one Postgres. Includes the TypeScript and Python SDK | ratel-ai | 566 | today | ||
| 7 | auraAURA is a production-tested SRE agent platform you can deploy in minutes. AURA handles the guardrails, APIs, state management, streaming, and failure handling required to put AI to work safely on production infrastructure. | mezmo | 415 | 1d ago | ||
| 8 | mcp-ts-coreAgent-native TypeScript framework for building MCP servers. | cyanheads | 155 | 8d ago | ||
| 9 | mcp-ts-templateTypeScript template for building MCP servers with declarative tooling, observability, and auth. | cyanheads | 155 | 8d ago | ||
| 10 | FanoutInvestigate OpenTelemetry traces, metrics, and logs, and manage personal dashboards. | labstack | 152 | today |
Infrastructure 39 indexed · 38 profiled
No compatibility evidence is collected for this form.
| # | Product | Publisher | Capabilities | GitHub stars | Last push | Save and compare |
|---|---|---|---|---|---|---|
| 1 | serve☁️ Build multimodal AI applications with cloud-native stack | jina-ai | 22k | 1y ago | ||
| 2 | RagaAI-CatalystPython SDK for Agent AI Observability, Monitoring and Evaluation Framework. Includes features like agent, llm and tools tracing, debugging multi-agentic system, self-hosted dashboard and advanced analytics with timeline and execution graph view | raga-ai-hub | 16k | 9mo ago | ||
| 3 | failproofaiObservability and enforcement for AI agent harnesses. Capture every run and runtime reliability with policy enforcement. | FailproofAI | 9.9k | today | ||
| 4 | latitude-llmOpen-source observability for AI agents. Find where your agents fail, dispatch your coding agent to fix it, and verify the fix against real traces. | latitude-dev | 4.8k | 3d ago | ||
| 5 | hamiltonApache Hamilton helps data scientists and engineers define testable, modular, self-documenting dataflows, that encode lineage/tracing and metadata. Runs and scales everywhere python does. | apache | 2.6k | 5d ago | ||
| 6 | future-agiOpen-source, end-to-end platform for evaluating, observing, and improving LLM and AI agent applications. Tracing · Evals · Simulations · Datasets · Gateway · Guardrails. Self-hostable. Apache 2.0. | future-agi | 2.3k | today | ||
| 7 | openinferenceOpenTelemetry Instrumentation for AI Observability | Arize-ai | 1.3k | today | ||
| 8 | langtraceLangtrace 🔍 is an open-source, Open Telemetry based end-to-end observability tool for LLM applications, providing real-time tracing, evaluations and metrics for popular LLMs, LLM frameworks, vectorDBs and more.. Integrate using Typescript, Python. 🚀💻📊 | Scale3-Labs | 1.2k | 1y ago | ||
| 9 | Tracely-aiTrace-native CI/CD for AI agents — production failures become regression tests that block the PR. Auto-detect, cluster, freeze into hermetic cases, replay in CI for $0. | Jwuthri | 1.1k | today | ||
| 10 | Tracely-aiTrace-native CI/CD for AI agents: grade production traces, cluster failures, freeze them into replayable regression tests, and block PRs that regress. Self-hostable. | jwuthri-cloud | 850 | 5d ago |
Agent skills 11 indexed · 11 profiled
Protocol-level reach: 26 of the 45 active platforms AgentSidekick tracks document support for the Agent Skills format. DER Which platforms
| # | Product | Publisher | Capabilities | GitHub stars | Last push | Save and compare |
|---|---|---|---|---|---|---|
| 1 | 13c-metabolic-fluxEstimates intracellular metabolic fluxes from steady-state carbon-13 isotope-tracing measurements using validated atom maps, mfapy isotope simulation, constrained multistart fitting, and flux-profile diagnostics. Use for 13C-MFA, carbon tracing, mass isotopomer distributions (MDVs/MIDs), positional isotopomers, parallel tracer experiments, and determining whether labeling data constrain a pathway flux. Distinguishes measured-label inference from COBRA flux balance analysis and flags experiments requiring nonstationary MFA. | K-Dense-AI | — | 5d ago | ||
| 2 | arize-instrumentationAdds Arize AX tracing to an LLM application for the first time. Follows a two-phase agent-assisted flow to analyze the codebase then implement instrumentation after user confirmation. Use when the user wants to instrument their app, add tracing from scratch, set up LLM observability, integrate OpenTelemetry or openinference, or get started with Arize tracing. | github | — | 1d ago | ||
| 3 | kubesphere-servicemeshKubeSphere ServiceMesh extension management Skill (Istio + Kiali + Jaeger). Use this skill for the ServiceMesh extension Configuration (covers installation, uninstallation, status checks), troubleshooting (covers grayscale release, sidecar injection, topology/metrics, and tracing for Composed Apps Aka Custom Applications). | kubesphere | — | 4mo ago | ||
| 4 | wiztelemetry-tracingUse when working with WizTelemetry Tracing extension for KubeSphere, including installation, configuration, and tracing query API | kubesphere | — | 4mo ago | ||
| 5 | pyvene-interventionsProvides guidance for performing causal interventions on PyTorch models using pyvene's declarative intervention framework. Use when conducting causal tracing, activation patching, interchange intervention training, or testing causal hypotheses about model behavior. | Orchestra-Research | — | 1mo ago | ||
| 6 | observability-and-instrumentationInstruments code so production behavior is visible and diagnosable. Use when adding logging, metrics, tracing, or alerting. Use when shipping any feature that runs in production and you need evidence it works. Use when production issues are reported but you can't tell what happened from the available data. | addyosmani | — | 2d ago | ||
| 7 | langfuseExpert in Langfuse - the open-source LLM observability platform. Covers tracing, prompt management, evaluation, datasets, and integration with LangChain, LlamaIndex, and OpenAI. Essential for debugging, monitoring, and improving LLM applications in production. | sickn33 | — | 1d ago | ||
| 8 | skill-security-auditAudit an Agent Skill, MCP server, connector, or desktop extension before installation by tracing code, dependencies, permissions, credentials, data flow, and irreversible actions. | sickn33 | — | 1d ago | ||
| 9 | observability-engineerBuild production-ready monitoring, logging, and tracing systems. Implements comprehensive observability strategies, SLI/SLO management, and incident response workflows. | sickn33 | — | 1d ago | ||
| 10 | service-mesh-observabilityImplement comprehensive observability for service meshes including distributed tracing, metrics, and visualization. Use when setting up mesh monitoring, debugging latency issues, or implementing SLOs for service communication. | wshobson | — | 3d ago |
Plugins 9 indexed · 9 profiled
9 of these are Claude plugins, which Claude Code documents (protocol-level). DER
| # | Product | Publisher | Capabilities | GitHub stars | Last push | Save and compare |
|---|---|---|---|---|---|---|
| 1 | deepevalSkills for adding DeepEval evaluations, tracing, datasets, Confident AI reports, and iterative improvement loops to AI applications. | confident-ai | 20k | 1d ago | ||
| 2 | langfuseSkills for working with Langfuse, the open-source LLM engineering platform for tracing, prompt management, and evaluation. | langfuse | 344 | 2d ago | ||
| 3 | ai-literacy-superpowersA set of Claude Code and GitHub Copilot plugins providing the AI Literacy framework's complete development workflow — harness engineering, agent orchestration, literate programming, CUPID code review, and the three enforcement loops | Habitat-Thinking | 124 | 5d ago | ||
| 4 | mlflowSkills for tracing, evaluating, and improving AI agents with MLflow. Supports the full agent improvement loop: instrument → trace → evaluate → iterate → validate. | mlflow | 91 | 17d ago | ||
| 5 | datahub-skillsDataHub development and interaction toolkit with connector planning, PR review, catalog search, metadata enrichment, lineage tracing, data quality management, and connection setup skills | datahub-project | 46 | 1mo ago | ||
| 6 | honeycombSkills, agents, and workflows for Honeycomb observability — query patterns, production investigations, SLOs, OpenTelemetry instrumentation, and Beeline migration. Designed to complement the Honeycomb MCP server. | honeycombio | 28 | 1d ago | ||
| 7 | dominodatalabFull Domino Data Lab platform support — workspaces, jobs, model deployment, experiment tracking, GenAI tracing, Spark/Ray/Dask, and app deployment for data science teams | dominodatalab | 7 | 14d ago | ||
| 8 | dash0OpenTelemetry observability for Claude Code sessions. Captures tool calls, LLM invocations, token usage, and errors as OTel traces. Send telemetry to Dash0 or any OpenTelemetry-compatible backend. | dash0hq | 6 | 2d ago | ||
| 9 | monitoring-observability-specialistUse this agent when you need to implement comprehensive monitoring, observability, and alerting systems for enterprise B2B applications. This agent specializes in APM, logging, metrics, distributed tracing, SLA monitoring, and proactive incident management for business-critical systems. Examples: | ccplugins | — | 3mo ago |
Developer tools 7 indexed · 7 profiled
No compatibility evidence is collected for this form.
| # | Product | Publisher | Capabilities | GitHub stars | Last push | Save and compare |
|---|---|---|---|---|---|---|
| 1 | LangfuseOpen-source LLM engineering platform for tracing, prompt management, evaluations and datasets, self-hosted or Langfuse Cloud. | ClickHouse (Langfuse) | 38k | today | ||
| 2 | MLflowOpen-source ML/GenAI lifecycle platform whose GenAI features include OpenTelemetry-compatible tracing, evaluation and prompt registry for agents. | Databricks (Linux Foundation) | 29k | today | ||
| 3 | OpikOpen-source platform for tracing, evaluating and monitoring LLM apps and agents, with LLM-as-judge metrics and prompt optimisation. | Comet | 23k | today | ||
| 4 | Arize PhoenixSelf-hostable tracing and evaluation tool built on OpenTelemetry/OpenInference for inspecting LLM and agent runs, datasets and experiments. | Arize-ai | 12k | today | ||
| 5 | LangWatchPlatform for LLM tracing, evaluations and agent simulation testing, self-hosted or cloud. | langwatch | 5.0k | today | ||
| 6 | LaminarOpen-source observability platform for agents with tracing, browser-session recordings, evaluations and SQL over trace data. | Laminar | 3.5k | today | ||
| 7 | W&B WeaveToolkit for tracing, evaluating and comparing LLM application versions, logged to Weights & Biases. | Weights & Biases (CoreWeave) | 1.2k | today |
Libraries 4 indexed · 3 profiled
No compatibility evidence is collected for this form.
| # | Product | Publisher | Capabilities | GitHub stars | Last push | Save and compare |
|---|---|---|---|---|---|---|
| 1 | OpenLLMetryOpenTelemetry-based instrumentation for LLM providers, vector DBs and frameworks that exports traces to any OTel backend. | traceloop | 7.5k | 2d ago | ||
| 2 | idun-agent-platform🟪 Open-source runtime that ships any LangGraph or Google ADK agent as a production-ready FastAPI service. Bundled , AG-UI copilotkit API, chat UI, 15+ guardrails, MCP, OpenTelemetry, OIDC. One pip install. Self-hosted, no vendor lock-in. | Idun-Group | 208 | 22d ago | ||
| 3 | e-commerce-agents6 specialized AI agents collaborating via A2A protocol to power e-commerce — product discovery, orders, pricing, reviews, inventory & support. Dual-stack (Python + .NET/C#) with generative UI. Built with Microsoft Agent Framework, FastAPI, Next.js, and PostgreSQL + pgvector. | nitin27may | 37 | today |
Agent projects 2 indexed · 2 profiled
No compatibility evidence is collected for this form.
| # | Product | Publisher | Capabilities | GitHub stars | Last push | Save and compare |
|---|---|---|---|---|---|---|
| 1 | greptimedbThe open-source observability database. One columnar engine for metrics, logs, and traces, on object storage. | GreptimeTeam | 6.8k | today | ||
| 2 | openlitSame agent, Smaller bill. The tools and infrastructure to get more work from your AI. Fewer tokens. Less compute. Lower cost. | openlit | 3.1k | 1d ago |
Frameworks 2 indexed · 2 profiled
No compatibility evidence is collected for this form.
| # | Product | Publisher | Capabilities | GitHub stars | Last push | Save and compare |
|---|---|---|---|---|---|---|
| 1 | LightAgentLightAgent: Lightweight Python framework for OpenAI-compatible agents with tools, memory, guardrails, tracing, lifecycle hooks, multi-agent collaboration, and workflows. | wanxingai | 1.2k | 6d ago | ||
| 2 | samplesAgent samples built using the Strands Agents SDK. | strands-agents | 943 | 3d ago |
SaaS products 2 indexed · 2 profiled
No compatibility evidence is collected for this form.
| # | Product | Publisher | Capabilities | GitHub stars | Last push | Save and compare |
|---|---|---|---|---|---|---|
| 1 | Pydantic LogfireOpenTelemetry-based observability service with first-class tracing for LLM calls, Pydantic AI agents and general Python apps, queryable with SQL. | pydantic | 4.6k | today | ||
| 2 | LangSmithHosted platform for tracing, debugging, evaluating and monitoring LLM apps and agents, framework-agnostic but integrated with LangChain and LangGraph. | LangChain | — | — |
Protocols & standards 1 indexed · 1 profiled
No compatibility evidence is collected for this form.
| # | Product | Publisher | Capabilities | GitHub stars | Last push | Save and compare |
|---|---|---|---|---|---|---|
| 1 | OpenTelemetry GenAI Semantic ConventionsStandard attribute and span definitions for tracing LLM calls, agent steps and tool executions, used by many observability tools to interoperate. | OpenTelemetry (CNCF) | 690 | today |
Agent SDKs 1 indexed · 1 profiled
No compatibility evidence is collected for this form.
| # | Product | Publisher | Capabilities | GitHub stars | Last push | Save and compare |
|---|---|---|---|---|---|---|
| 1 | OpenAI Agents SDKLightweight SDK for multi-agent workflows with agents, handoffs, guardrails, sessions and built-in tracing; works with OpenAI and other model providers. | openai | 31k | today |
Which platforms these forms can reach
All platformsProtocol-level: the platform documents support for the standard. No specific pairing has been tested.
MCP servers 99 indexed here
36 platforms document MCP support CUR.
ContinueOpenCodeClaude CodeCodexGemini CLIZedOpenHandsClineWarpgooseQwen CodeBolt (bolt.new)KiroAmazon Bedrock AgentCoreAmpApps in ChatGPT / Apps SDK (now ChatGPT Plugins)Augment CodeChatGPTClaude (claude.ai apps)Claude DesktopCursorDevinDevin Desktop (formerly Windsurf)Factory (Droid)Gemini (app)Gemini Enterprise Agent Platform (formerly Vertex AI / Vertex AI Agent Builder)GitHub CopilotGitHub Copilot cloud agent (formerly Copilot coding agent)Google AntigravityJetBrains AI AssistantJunieLovableMicrosoft Copilot StudioReplit AgentTabninev0
Agent skills 11 indexed here
26 platforms document Agent Skills support CUR.
OpenClawOpenCodeClaude CodeCodexGemini CLIOpenHandsWarpgooseBolt (bolt.new)KiroAmpApps in ChatGPT / Apps SDK (now ChatGPT Plugins)ChatGPTClaude (claude.ai apps)Claude DesktopCursorDevinDevin Desktop (formerly Windsurf)Factory (Droid)Gemini (app)GitHub CopilotGitHub Copilot cloud agent (formerly Copilot coding agent)Google AntigravityJunieReplit AgentTabnine
Platforms publishers name
| Platform | Profiled products naming it |
|---|---|
| Claude Code | 7 |
| Cursor | 4 |
| Codex | 4 |
| OpenClaw | 2 |
| ChatGPT | 1 |
| Apps in ChatGPT / Apps SDK (now ChatGPT Plugins) | 1 |
| GitHub Copilot | 1 |
Integrations most often paired
Third-party services named by products with this capability, whole catalogue.
| Integration | Products | Share |
|---|---|---|
| PostgreSQL | 3 | 1.7% |
| Datadog | 2 | 1.1% |
| GitHub | 2 | 1.1% |
| Grafana | 2 | 1.1% |
| Blender | 1 | 0.6% |
| Google Cloud | 1 | 0.6% |
| Kubernetes | 1 | 0.6% |
| Microsoft Excel | 1 | 0.6% |
| Sentry | 1 | 0.6% |
| Solana | 1 | 0.6% |
Keywords that trigger this capability
Matched as whole words, ignoring case, in a product's name, description and repository topics.
| Keyword | Products matched |
|---|---|
| tracing | 84 |
| llm tracing | 1 |
| agent tracing | 4 |
| distributed tracing | 4 |
| opentelemetry | 84 |
| trace viewer | 0 |
Segment statistics
Whole catalogue (177 indexed products). Calculated 2026-11-21.
Lagging the catalogue. Mid-sized among capabilities, with launches growing more slowly than the catalogue’s. Size is ranked against all capabilities; momentum compares launches in the last 90 days with the 90 before, relative to the catalogue’s own ratio (62 or more = faster, 38 or less = slower; under 5 dated launches it is not measured). The HHI of 0.077 means stars are spread as if across about 13 equally popular projects — unconcentrated by the common 0.15 / 0.25 thresholds. Stars measure attention, not usage or quality.
Limits
- Classification is by the keywords above. A product that offers this capability without using one of them is not counted; one that uses a keyword in another sense is counted wrongly. Methodology
- Platform reach is protocol-level: it says a platform documents the standard, not that any product here was tested on it. Platforms named by publishers are their own claims.
- Stars belong to repositories. Products in a subfolder of a large repository show that whole repository’s stars and are excluded from the concentration figures.
- Launch counts use each source’s publication date; for auto-discovered repositories that is the repository’s creation date.
Page data last updated .