Catalog Systems Evaluation & observability platforms HoneyHive

HoneyHive

https://www.honeyhive.ai/

Agent observability and evaluation platform for replaying traces step by step, debugging long-running multi-agent trajectories and evaluating live production traffic.

Active · Verified 2026-10-29 · fresh as of 2026-10-29 · 15 cited facts, 0 with a third-party source · 1 recorded change · Suggest a correction

At a glance

Type: Product vendor fix
Tier: T3
Section: Evaluation & observability platforms
Created: searched not found fix
Latest release: searched not found fix
License: proprietary vendor fix
GitHub: not applicable — no GitHub repo fix
Pricing: searched not found fix
Funding: searched not found fix
Freshness: 2026-10-29 fix
Layer: agent-infra repo fix
Licensing: commercial vendor fix
SDK languages: python, rest, typescript vendor fix
Protocols: opentelemetry vendor fix
Compliance: gdpr, hipaa, soc2-type2 vendor fix

When to use

Optimised for: searched not found

Anti-fit: searched not found

Pros & cons

Pros

searched not found

Cons

searched not found

Claims & capabilities

Inspect every prompt, tool call, output, and handoff.

Technical surface

API surface: searched not found
Backend storage: searched not found
Deployment: searched not found
Embedding model: searched not found
Multi-tenancy: searched not found
MCP: searched not found
A2A: searched not found
OpenTelemetry: yes

Similar systems

Other evaluation & observability platforms in the catalog, ranked by inbound references.

Arize Phoenix T1
Arize AI's open-source LLM observability tool — OpenTelemetry-native LLM tracing, evals, datasets. Arize commercial offers Phoenix + Surveyor.
Arize AI T1
Production ML monitoring + LLM observability (Arize AX) — drift, eval, root-cause. Pre-LLM observability leader; now LLM-pivoted.
Braintrust T1
Eval-first LLM platform — datasets, eval runs, prompt playground, tracing. Founded by ex-Impira (acquired by Dropbox) team. Used by Notion, Brex, AirOps.
Confident AI / DeepEval T2
Open-source DeepEval framework + Confident AI cloud — pytest-style eval runs, hallucination/relevance/bias metrics, datasets.
OpenLLMetry (Traceloop) T2
Traceloop's open-source OpenTelemetry auto-instrumentation for LLM workflows — works with any OTel-compatible backend (Datadog, New Relic, Grafana, etc.).
Helicone T2
Open-source LLM observability and AI gateway — one-line proxy integration captures every LLM call; sessions, custom properties, evals. Acquired by Mintlify in Mar 2026 and placed in maintenance mode; helicone.ai now states it is no longer part of Mintlify.

Sources (14 cited facts, 0 third-party)

Each fact links to the page it came from; the badge says who published it (how to read sources).

What it is Product vendor
What it does & what's distinct Agent observability and evaluation platform for replaying traces step by step, debugging… vendor
Claims / benefits Inspect every prompt, tool call, output, and handoff. vendor
License proprietary vendor
OTel yes vendor
Project & sources https://www.honeyhive.ai/ vendor
obs-opentelemetry yes vendor
obs-datadog yes vendor
eval-human-loop yes vendor
licensing-bucket commercial vendor
taxonomy-three-layer-rollup agent-infra repo
compliance-certifications gdpr,hipaa,soc2-type2 vendor
sdk-languages python,rest,typescript vendor
protocol-support opentelemetry vendor

What changed

Changes to this record's lifecycle, licence, release, pricing and hosting facts, from the catalog's git history. Subscribe (Atom)

2026-10-30 Added to the catalog #347

Related systems

References (25)

Anthropic Claude (foundation models) integrates with — HoneyHive integrations docs have a Anthropic tracing/integration page. (verified 2026-10-29)
AutoGen / AG2 integrates with — HoneyHive integrations docs have a Microsoft AutoGen tracing/integration page. (verified 2026-10-29)
Claude Agent SDK integrates with — HoneyHive integrations docs have a Claude Agent SDK tracing/integration page. (verified 2026-10-29)
Claude Code (Anthropic) integrates with — HoneyHive integrations docs have a Claude Code tracing/integration page. (verified 2026-10-29)
Cloudflare AI Gateway integrates with — HoneyHive integrations docs have a Cloudflare AI Gateway tracing/integration page. (verified 2026-10-29)
CrewAI integrates with — HoneyHive integrations docs have a CrewAI tracing/integration page. (verified 2026-10-29)
Devin (Cognition) integrates with — HoneyHive integrations docs have a Devin tracing/integration page. (verified 2026-10-29)
DSPy integrates with — HoneyHive integrations docs have a DSPy tracing/integration page. (verified 2026-10-29)
Google Agent Development Kit (ADK) integrates with — HoneyHive integrations docs have a Google ADK tracing/integration page. (verified 2026-10-29)
Google Gemini 3 family integrates with — HoneyHive integrations docs have a Gemini tracing/integration page. (verified 2026-10-29)
LangChain (framework) integrates with — HoneyHive integrations docs have a LangChain tracing/integration page. (verified 2026-10-29)
LangGraph (orchestration) integrates with — HoneyHive integrations docs have a LangGraph tracing/integration page. (verified 2026-10-29)
LiteLLM integrates with — HoneyHive integrations docs have a LiteLLM tracing/integration page. (verified 2026-10-29)
LlamaIndex (framework) integrates with — HoneyHive integrations docs have a LlamaIndex tracing/integration page. (verified 2026-10-29)
Microsoft Semantic Kernel integrates with — HoneyHive integrations docs have a Semantic Kernel tracing/integration page. (verified 2026-10-29)
n8n (AI agent flows) integrates with — HoneyHive integrations docs have a n8n tracing/integration page. (verified 2026-10-29)
OpenAI Agents SDK integrates with — HoneyHive integrations docs have a OpenAI Agents SDK tracing/integration page. (verified 2026-10-29)
OpenAI Codex CLI integrates with — HoneyHive integrations docs have a OpenAI Codex CLI tracing/integration page. (verified 2026-10-29)
OpenAI GPT family (GPT-5 / GPT-4o / o3 / o4) integrates with — HoneyHive integrations docs have a OpenAI tracing/integration page. (verified 2026-10-29)
Portkey AI integrates with — HoneyHive integrations docs have a Portkey tracing/integration page. (verified 2026-10-29)
Pydantic-AI integrates with — HoneyHive integrations docs have a Pydantic AI tracing/integration page. (verified 2026-10-29)
Salesforce Agentforce integrates with — HoneyHive integrations docs have a Salesforce Agentforce tracing/integration page. (verified 2026-10-29)
Strands Agents (AWS) integrates with — HoneyHive integrations docs have a AWS Strands Agents tracing/integration page. (verified 2026-10-29)
TrueFoundry AI Gateway integrates with — HoneyHive integrations docs have a TrueFoundry tracing/integration page. (verified 2026-10-29)
Vercel AI Gateway integrates with — HoneyHive integrations docs have a Vercel AI Gateway tracing/integration page. (verified 2026-10-29)

Referenced by (3)

LlamaIndex (framework) integrates with — LlamaIndex observability module guide has a HoneyHive section. (verified 2026-10-29)
OpenAI Agents SDK integrates with — OpenAI Agents SDK tracing docs list HoneyHive among external tracing processors. (verified 2026-10-29)
TrueFoundry AI Gateway integrates with — TrueFoundry AI Gateway ecosystem lists a HoneyHive integration page. (verified 2026-10-29)