OpenLLMetry vs Datadog LLM Observability
OpenLLMetry is a library from traceloop (Apache-2.0 licence, 7.5k GitHub stars, last push 2026-11-19); Datadog LLM Observability is a saaS product from Datadog (licence unknown, no public repository metrics). They share 3 of 6 capabilities and integrations identified for either (overlap 0.60); only OpenLLMetry covers Tracing; only Datadog LLM Observability covers Cost Monitoring, Datadog. Figures as of 2026-11-21. DER
OpenLLMetry profileDatadog LLM Observability profileOpen in the compare tool
Side-by-side facts
11 of 16 rows differ (marked). Unknown means no source we track states it.
| Field | OpenLLMetry | Datadog LLM Observability |
|---|---|---|
| Type · differs | Library · library CUR | SaaS product · hosted CUR |
| Publisher · differs | traceloop SRC | Datadog CUR |
| Licence · differs | Apache-2.0 CUR | Unknown |
| Open source · differs | Yes CUR | No CUR |
| Pricing model · differs | open-source CUR | paid CUR |
| Hosting | Unknown | Unknown |
| Latest version | Unknown | Unknown |
| Languages · differs | python CUR | Unknown |
| GitHub stars · differs | 7.5k (7,545) SRC | Unknown |
| Forks · differs | 1.2k SRC | Unknown |
| Last push · differs | 2026-11-19 SRC | Unknown |
| Archived · differs | No SRC | Unknown |
| First published · differs | 2023-09-02 SRC | Unknown |
| Versions recorded | Unknown | Unknown |
| Verification | Checked by AgentSidekick against official sources CUR | Checked by AgentSidekick against official sources CUR |
| Last verified | 2026-11-21 CUR | 2026-11-21 CUR |
Shared and unique capabilitiesDER
Capabilities are assigned by keyword rules from each description unless a researcher set them; integrations are services named in the description or package metadata.
Both (3)
Only OpenLLMetry (1)
Only Datadog LLM Observability (2)
Platform compatibility
Status per platform from the evidence we hold. No pairing has been tested by AgentSidekick.
No compatibility evidence
For all 47 platforms on record the status is Unknown or Platform discontinued for both: neither product type implements a standard we can check (MCP, Agent Skills, Claude plugins) and neither publisher names a platform.
Maintenance
Repository activity read from the GitHub API. Activity is not quality.
| Measure | OpenLLMetry | Datadog LLM Observability |
|---|---|---|
| Status | Active DER | Unknown UNK |
| Days since last push | 2 DER | Unknown |
| Open issues | 170 SRC | Unknown |
| Latest GitHub release | 0.63.1 · 2026-11-16 SRC | Unknown |
| Newest registry version | Unknown | Unknown |
Evaluation dimensions
Separate signals with their evidence; there is no overall score. Hover or focus a status for its evidence.
| Dimension | OpenLLMetry | Datadog LLM Observability |
|---|---|---|
| Source authority | Checked against official sources | Checked against official sources |
| Publisher verification | Organisation account | Organisation account |
| Maintenance activity · differs | Active | Unknown |
| Licence clarity · differs | Apache-2.0 | Unknown |
| Installation clarity | Linked | Linked |
| Documentation | Docs linked | Docs linked |
| Compatibility evidence | Unknown | Unknown |
| Security review | Not reviewed | Not reviewed |
Which fits which requirementDER
Derived from the differences above, one rule per line. Nothing here says either product is better; check the requirement against your own needs.
Choose OpenLLMetry if…
- you need an OSI-style open-source licence (OpenLLMetry: Apache-2.0; Datadog LLM Observability: none on record)
- you need Tracing (classified for OpenLLMetry only)
- you require a repository pushed to in the last 90 days (OpenLLMetry: 2026-11-19; Datadog LLM Observability: no repository metrics)
Choose Datadog LLM Observability if…
- you need Cost Monitoring (classified for Datadog LLM Observability only)
- you need an integration with Datadog (named for Datadog LLM Observability only)
Sources
- OpenLLMetry · GitHub topic search: github.com (external)checked
- OpenLLMetry · Curated research: traceloop.com (external)checked
- OpenLLMetry · Researcher checked: traceloop.com (external)checked
- OpenLLMetry · Researcher checked: traceloop.com (external)checked
- OpenLLMetry · Researcher checked: github.com (external)checked
- Datadog LLM Observability · Curated research: docs.datadoghq.com (external)checked
- Datadog LLM Observability · Researcher checked: docs.datadoghq.com (external)checked
Page data last updated .