← Analyses

Observability coverage

Which products and frameworks integrate with which observability stack? Per the May 2026 volumetric agent, observability / debugging is the single highest-demand question in agent infrastructure (807 HN hits in the last 12 months, 89% adoption in LangChain's State of Agent Engineering 2025, six of seven published surveys treat it as a top-three challenge). This matrix pivots the catalog's eight obs-* columns into a coverage view.

Coverage: 84/912 products (9.2%) have at least one observability cell filled in. Of those analyzed, 52.4% declare support for at least one of the seven tracked tools. The rest of the catalog (mostly research papers and depth-floor rows) is surfaced as unknown by default — the matrix explicitly shows where research has bottomed out rather than papering over the gap.

Per-tool support

Out of 84 analyzed products. Bars scale to the leader; numbers are absolute supportedCount.

  • LangSmith 21 (25.0%)
  • OpenTelemetry 26 (31.0%)
  • Datadog 24 (28.6%)
  • Helicone 17 (20.2%)
  • Weave (W&B) 17 (20.2%)
  • Langfuse 20 (23.8%)
  • Arize 14 (16.7%)

Leader: OpenTelemetry with 26 supported products (31.0% of analyzed).

Legend

  • yes documented integration — citation in the cell tooltip
  • no no integration / not applicable for this product class
  • unknown not yet researched or research bottomed out at the depth-floor; treat as "we don't know"

Matrix — showing 84 of 912

ProductTierSectionLangSmithOpenTelemetryDatadogHeliconeWeave (W&B)LangfuseArizeCoverage
Anthropic Claude (foundation models) LangSmithT1Foundation models (substrate reference)7 / 7
Anthropic Computer Use LangSmithT1Agent frameworks (no first-party memory layer)7 / 7
Anthropic Computer Use LangSmithT1Agent IDEs & coding harnesses7 / 7
Gemini Enterprise Agent Platform Memory Bank (rebrand of Vertex AI Memory Bank) LangSmithT1Platform-provider memory7 / 7
Google Gemini Memory LangSmithT1Platform-provider memory7 / 7
LangGraph (orchestration) LangSmithT1Agent frameworks (no first-party memory layer)7 / 7
OpenAI Agents SDK LangSmithT1Agent frameworks (no first-party memory layer)7 / 7
OpenAI Realtime API LangSmithT1Voice agent platforms7 / 7
CrewAI LangSmithT1Agent frameworks (no first-party memory layer)6 / 7
Mistral Le Chat — Memories LangSmithT1Platform-provider memory6 / 7
Mistral Vibe (Remote Agents) + Mistral Medium 3.5 LangSmithT1Coding-agent memory6 / 7
Anthropic Claude Memory DatadogT1Platform-provider memory5 / 7
DeepSeek R1 / V3 family LangSmithT1Foundation models (substrate reference)5 / 7
Alibaba Qwen 3 family LangSmithT1Foundation models (substrate reference)4 / 7
AutoGen / AG2 OpenTelemetryT1Agent frameworks (no first-party memory layer)4 / 7
Neo4j LangSmithT1Knowledge-graph platforms3 / 7
Grok Memory (xAI) LangSmithT1Platform-provider memory3 / 7
OpenHands (All Hands AI) LangSmithT1Agent IDEs & coding harnesses3 / 7
Amazon Neptune Analytics OpenTelemetryT1Knowledge-graph platforms2 / 7
Amazon Q Developer OpenTelemetryT1Agent IDEs & coding harnesses2 / 7
Arize Phoenix OpenTelemetryT1Evaluation & observability platforms2 / 7
Claude Code (Anthropic) OpenTelemetryT1Agent IDEs & coding harnesses2 / 7
Claude Code auto-memory OpenTelemetryT1Claude Code memory mechanisms2 / 7
CLAUDE.md OpenTelemetryT1File-backed / editor paradigms2 / 7
Datadog Bits AI OpenTelemetryT1Use-case-specific agent harnesses2 / 7
Microsoft Copilot Memory OpenTelemetryT1Platform-provider memory2 / 7
v0 (Vercel) OpenTelemetryT1Agent IDEs & coding harnesses2 / 7
LanceDB LangSmithT1Vector-database infrastructure2 / 7
OpenAI Codex CLI OpenTelemetryT1Agent IDEs & coding harnesses2 / 7
Mem0 LangSmithT1Dedicated memory layers2 / 7
Braintrust OpenTelemetryT1Evaluation & observability platforms1 / 7
Perplexity Deep Research HeliconeT1Use-case-specific agent harnesses1 / 7
Hugging Face LeRobot Weave (W&B)T1Robotics foundation models & agent stacks1 / 7
Salesforce Agentforce DatadogT1Use-case-specific agent harnesses1 / 7
NVIDIA GR00T / Isaac Weave (W&B)T1Robotics foundation models & agent stacks1 / 7
Browser Use LangSmithT1Computer-use & desktop agents1 / 7
Cline (framework) HeliconeT1Agent frameworks (no first-party memory layer)1 / 7
Cognee LangfuseT1Dedicated memory layers1 / 7
Continue.dev (framework) OpenTelemetryT1Agent frameworks (no first-party memory layer)1 / 7
ElevenLabs Conversational AI LangfuseT1Voice agent platforms1 / 7
Graphiti MCP Server (Zep) LangSmithT1Claude Code memory mechanisms1 / 7
Letta / MemGPT OpenTelemetryT1Dedicated memory layers1 / 7
Sourcegraph Cody (agent) OpenTelemetryT1Agent IDEs & coding harnesses1 / 7
Zep & Graphiti LangSmithT1Dedicated memory layers1 / 7
Abridge T1Vertical / domain-specific AI memory0 / 7
AGENTS.md T1File-backed / editor paradigms0 / 7
Bolt.new (StackBlitz) — harness T1Agent IDEs & coding harnesses0 / 7
Character.ai T1Vertical / domain-specific AI memory0 / 7
ChatGPT — Codex (cloud agent) T1Agent IDEs & coding harnesses0 / 7
Claude for Chrome T1Computer-use & desktop agents0 / 7
claude-mem T1Claude Code memory mechanisms0 / 7
Cognition Devin v2 / Spec Mode T1Agent IDEs & coding harnesses0 / 7
Decagon T1Vertical / domain-specific AI memory0 / 7
Devin (Cognition) T1Coding-agent memory0 / 7
Engram (DeepSeek) T1Recent method papers — theorized, no distinct product0 / 7
Google DeepMind Gemini Robotics T1Robotics foundation models & agent stacks0 / 7
Granola T1Voice-first / wearable AI memory0 / 7
Harvey Memory T1Vertical / domain-specific AI memory0 / 7
Hippocratic AI Polaris T1Vertical / domain-specific AI memory0 / 7
HubSpot Breeze AI Agents T1Use-case-specific agent harnesses0 / 7
LinkedIn Cognitive Memory Agent T1Platform-provider memory0 / 7
Lovable.dev — harness T1Agent IDEs & coding harnesses0 / 7
Meta AI Memory T1Platform-provider memory0 / 7
Microsoft Edge Copilot Mode + Journeys T1Browser-agent memory0 / 7
NVIDIA Nemotron 3 T1Recent method papers — theorized, no distinct product0 / 7
OpenAI ChatGPT Memory T1Platform-provider memory0 / 7
OpenAI Deep Research T1Use-case-specific agent harnesses0 / 7
OpenAI Operator T1Computer-use & desktop agents0 / 7
Perplexity Comet T1Browser-agent memory0 / 7
Physical Intelligence (π) T1Robotics foundation models & agent stacks0 / 7
Project Mariner T1Computer-use & desktop agents0 / 7
Sierra T1Vertical / domain-specific AI memory0 / 7
Suki AI T1Vertical / domain-specific AI memory0 / 7
Wayve GAIA-2 / GAIA-3 T1Vertical / domain-specific AI memory0 / 7
GraphRAG (Microsoft) T1Retrieval-as-memory hybrids0 / 7
MCP Servers (Reference) T1Agent frameworks (no first-party memory layer)0 / 7
Model Context Protocol (MCP spec) T1Agent frameworks (no first-party memory layer)0 / 7
Official MCP Memory server T1Claude Code memory mechanisms0 / 7
Anthropic Auto Dream T1Claude Code memory mechanisms0 / 7
GitHub Copilot Workspace T1Agent IDEs & coding harnesses0 / 7
JetBrains AI Assistant T1Agent IDEs & coding harnesses0 / 7
Lucidworks Conversational Q&A AI Agent T1Enterprise-search adjacencies0 / 7
Sinequa T1Enterprise-search adjacencies0 / 7
Cursor Rules T1File-backed / editor paradigms0 / 7
← Analyses hub Pivot of obs-* cells. Helper in $lib/analyses/observability.ts. Schema in docs/SCHEMA.md §2.5.1.