← Analyses

Observability coverage

Which products and frameworks integrate with which observability stack? Per the May 2026 volumetric agent, observability / debugging is the single highest-demand question in agent infrastructure (807 HN hits in the last 12 months, 89% adoption in LangChain's State of Agent Engineering 2025, six of seven published surveys treat it as a top-three challenge). This matrix pivots the catalog's eight obs-* columns into a coverage view.

Coverage: 105/1002 products (10.5%) have at least one observability cell filled in. Of those analyzed, 62.9% declare support for at least one of the seven tracked tools. The rest of the catalog (mostly research papers and depth-floor rows) is surfaced as unknown by default — the matrix explicitly shows where research has bottomed out rather than papering over the gap.

Per-tool support

Out of 105 analyzed products. Bars scale to the leader; numbers are absolute supportedCount.

  • LangSmith 23 (21.9%)
  • OpenTelemetry 43 (41.0%)
  • Datadog 30 (28.6%)
  • Helicone 16 (15.2%)
  • Weave (W&B) 16 (15.2%)
  • Langfuse 23 (21.9%)
  • Arize 17 (16.2%)

Leader: OpenTelemetry with 43 supported products (41.0% of analyzed).

Legend

  • yes documented integration — citation in the cell tooltip
  • no no integration / not applicable for this product class
  • unknown not yet researched or research bottomed out at the depth-floor; treat as "we don't know"

Matrix — showing 105 of 1002

ProductTierSectionLangSmithOpenTelemetryDatadogHeliconeWeave (W&B)LangfuseArizeCoverage
Anthropic Claude (foundation models) LangSmithT1Foundation models (substrate reference)●●●●●●●7 / 7
Anthropic Computer Use LangSmithT1Computer-use & desktop agents●●●●●●●7 / 7
Google Gemini Memory LangSmithT1Platform-provider memory●●●●●●●7 / 7
LangGraph (orchestration) LangSmithT1Agent frameworks (no first-party memory layer)●●●●●●●7 / 7
OpenAI Agents SDK LangSmithT1Agent frameworks (no first-party memory layer)●●●●●●●7 / 7
OpenAI Realtime API LangSmithT1Voice agent platforms●●●●●●●7 / 7
Vertex AI Memory Bank (now Agent Platform Memory Bank) LangSmithT2Platform-provider memory●●●●●●●7 / 7
CrewAI LangSmithT1Agent frameworks (no first-party memory layer)●●●–●●●6 / 7
Mistral Le Chat — Memories (now Vibe) LangSmithT1Platform-provider memory●–●●●●●6 / 7
Mistral Vibe (Remote Agents) + Mistral Medium 3.5 LangSmithT1Coding-agent memory●–●●●●●6 / 7
Anthropic Claude Memory DatadogT1Platform-provider memory○–●●●●●5 / 7
agentgateway LangSmithT3Inference platforms & gateways●●●––●●5 / 7
DeepSeek R1 / V3 family LangSmithT1Foundation models (substrate reference)●–●●●●–5 / 7
Pydantic Logfire LangSmithT3Evaluation & observability platforms●●●––●●5 / 7
Alibaba Qwen 3 family LangSmithT1Foundation models (substrate reference)●–●–●●–4 / 7
AutoGen / AG2 OpenTelemetryT1Agent frameworks (no first-party memory layer)–●––●●●4 / 7
Neo4j LangSmithT1Knowledge-graph platforms●●●○○○○3 / 7
Grok Memory (xAI) LangSmithT1Platform-provider memory●––●–●–3 / 7
OpenHands LangSmithT1Agent IDEs & coding harnesses●––●–●–3 / 7
Amazon Neptune Analytics OpenTelemetryT1Knowledge-graph platforms○●●○○○○2 / 7
Amazon Q Developer OpenTelemetryT1Agent IDEs & coding harnesses○●●○○○○2 / 7
Arize Phoenix OpenTelemetryT1Evaluation & observability platforms○●○○○○●2 / 7
Claude Code (Anthropic) OpenTelemetryT1Agent IDEs & coding harnesses○●●○○○○2 / 7
Claude Code auto-memory OpenTelemetryT1Claude Code memory mechanisms○●●○○○○2 / 7
CLAUDE.md OpenTelemetryT1File-backed / editor paradigms○●●○○○○2 / 7
Datadog Bits AI OpenTelemetryT1Use-case-specific agent harnesses○●●○○○○2 / 7
Microsoft Copilot Memory OpenTelemetryT1Platform-provider memory○●●○○○○2 / 7
v0 (Vercel) OpenTelemetryT1Agent IDEs & coding harnesses○●●○○○○2 / 7
LanceDB LangSmithT1Vector-database infrastructure●●–○○○○2 / 7
OpenAI Codex CLI OpenTelemetryT1Agent IDEs & coding harnesses○●–●–––2 / 7
Datadog Agent Observability (LLM Observability) OpenTelemetryT3Evaluation & observability platforms–●●––––2 / 7
Dify LangfuseT3Agent frameworks (no first-party memory layer)–––––●●2 / 7
HoneyHive OpenTelemetryT3Evaluation & observability platforms–●●––––2 / 7
IBM ContextForge MCP Gateway OpenTelemetryT3MCP gateways & registries–●●––––2 / 7
Langflow LangSmithT3Agent frameworks (no first-party memory layer)●––––●–2 / 7
Mem0 LangSmithT1Dedicated memory layers●––––●–2 / 7
Braintrust OpenTelemetryT1Evaluation & observability platforms○●○○○○○1 / 7
Perplexity Deep Research HeliconeT1Use-case-specific agent harnesses○○○●○○○1 / 7
Hugging Face LeRobot Weave (W&B)T1Robotics foundation models & agent stacks○–○○●○○1 / 7
Salesforce Agentforce DatadogT1Use-case-specific agent harnesses○–●○○○○1 / 7
NVIDIA GR00T / Isaac Weave (W&B)T1Robotics foundation models & agent stacks○––○●○○1 / 7
Agent Router (formerly Envoy AI Gateway) OpenTelemetryT3Inference platforms & gateways–●–––––1 / 7
agentmemory (rohitg00) OpenTelemetryT3Coding-agent memory–●–––––1 / 7
Arthur Engine OpenTelemetryT3Guardrails & AI security–●–––––1 / 7
Bifrost (Maxim AI) OpenTelemetryT3Inference platforms & gateways–●–––––1 / 7
Browser Use LangSmithT1Computer-use & desktop agents●––––––1 / 7
Cline (framework) HeliconeT1Agent frameworks (no first-party memory layer)–––●–––1 / 7
Cloudflare AI Gateway OpenTelemetryT3Inference platforms & gateways–●–––––1 / 7
Cognee LangfuseT1Dedicated memory layers–––––●–1 / 7
context-mode DatadogT3Coding-agent memory––●––––1 / 7
Continue.dev OpenTelemetryT2Agent IDEs & coding harnesses–●–––––1 / 7
Docker MCP Catalog, Toolkit & Gateway OpenTelemetryT3MCP gateways & registries–●–––––1 / 7
ElevenLabs Conversational AI (now ElevenAgents) LangfuseT1Voice agent platforms–––––●–1 / 7
GitHub Copilot Memory (agentic memory) OpenTelemetryT3Coding-agent memory–●–––––1 / 7
Golem OpenTelemetryT3Durable execution & workflow engines–●–––––1 / 7
Graphiti MCP Server (Zep) LangSmithT1Claude Code memory mechanisms●––––––1 / 7
Hatchet OpenTelemetryT3Durable execution & workflow engines–●–––––1 / 7
Laminar OpenTelemetryT3Evaluation & observability platforms–●–––––1 / 7
Letta / MemGPT OpenTelemetryT1Dedicated memory layers–●–––––1 / 7
Merge Agent Handler ArizeT3Agent identity & auth––––––●1 / 7
Microsoft Agent Framework OpenTelemetryT3Agent frameworks (no first-party memory layer)–●–––––1 / 7
NVIDIA NeMo Guardrails OpenTelemetryT3Guardrails & AI security–●–––––1 / 7
OpenClaw memory OpenTelemetryT3File-backed / editor paradigms–●–––––1 / 7
Sourcegraph Cody (agent) OpenTelemetryT1Agent IDEs & coding harnesses–●–––––1 / 7
TrueFoundry AI Gateway DatadogT3Inference platforms & gateways––●––––1 / 7
Zep & Graphiti LangSmithT1Dedicated memory layers●––––––1 / 7
Abridge T1Vertical / domain-specific AI memory○○○○○○○0 / 7
AGENTS.md T1File-backed / editor paradigms○○○○○○○0 / 7
Bolt.new (StackBlitz) — harness T1Agent IDEs & coding harnesses○○○○○○○0 / 7
Character.ai T1Vertical / domain-specific AI memory○○○○○○○0 / 7
ChatGPT — Codex (cloud agent) T1Agent IDEs & coding harnesses○○○○○○○0 / 7
Claude for Chrome T1Computer-use & desktop agents○○○○○○○0 / 7
claude-mem T1Claude Code memory mechanisms○○○○○○○0 / 7
Cognition Devin v2 / Spec Mode T1Agent IDEs & coding harnesses○○○○○○○0 / 7
Decagon T1Vertical / domain-specific AI memory○○○○○○○0 / 7
Devin (Cognition) T1Coding-agent memory○○○○○○○0 / 7
Engram (DeepSeek) T1Recent method papers — theorized, no distinct product○○○○○○○0 / 7
Google DeepMind Gemini Robotics T1Robotics foundation models & agent stacks○○○○○○○0 / 7
Granola T1Voice-first / wearable AI memory○○○○○○○0 / 7
Harvey Memory T1Vertical / domain-specific AI memory○○○○○○○0 / 7
Hippocratic AI Polaris T1Vertical / domain-specific AI memory○○○○○○○0 / 7
HubSpot Breeze AI Agents T1Use-case-specific agent harnesses○○○○○○○0 / 7
LinkedIn Cognitive Memory Agent T1Platform-provider memory○○○○○○○0 / 7
Lovable.dev — harness T1Agent IDEs & coding harnesses○○○○○○○0 / 7
Meta AI Memory T1Platform-provider memory○○○○○○○0 / 7
Microsoft Edge Copilot Mode + Journeys (now Copilot in Edge) T1Browser-agent memory○○○○○○○0 / 7
NVIDIA Nemotron 3 T1Recent method papers — theorized, no distinct product○○○○○○○0 / 7
OpenAI ChatGPT Memory T1Platform-provider memory○○○○○○○0 / 7
OpenAI Deep Research T1Use-case-specific agent harnesses○○○○○○○0 / 7
OpenAI Operator T1Computer-use & desktop agents○○○○○○○0 / 7
Perplexity Comet T1Browser-agent memory○○○○○○○0 / 7
Physical Intelligence (π) T1Robotics foundation models & agent stacks○○○○○○○0 / 7
Project Mariner T1Computer-use & desktop agents○○○○○○○0 / 7
Sierra T1Vertical / domain-specific AI memory○○○○○○○0 / 7
Suki AI T1Vertical / domain-specific AI memory○○○○○○○0 / 7
Wayve GAIA-2 / GAIA-3 T1Vertical / domain-specific AI memory○○○○○○○0 / 7
GraphRAG (Microsoft) T1Retrieval-as-memory hybrids○–○○○○○0 / 7
MCP Servers (Reference) T1Agent frameworks (no first-party memory layer)○–○○○○○0 / 7
Model Context Protocol (MCP spec) T1Agent frameworks (no first-party memory layer)○–○○○○○0 / 7
Official MCP Memory server T1Claude Code memory mechanisms○–○○○○○0 / 7
GitHub Copilot Workspace T1Agent IDEs & coding harnesses○––○○○○0 / 7
JetBrains AI Assistant T1Agent IDEs & coding harnesses○––○○○○0 / 7
Lucidworks Conversational Q&A AI Agent T1Enterprise-search adjacencies○––○○○○0 / 7
Sinequa T1Enterprise-search adjacencies○––○○○○0 / 7
Cursor Rules T1File-backed / editor paradigms○––––––0 / 7
← Analyses hub Pivot of obs-* cells. Helper in $lib/analyses/observability.ts. Schema in docs/SCHEMA.md (section 2.5.1).