Arize Phoenix
Arize AI's open-source LLM observability tool — OpenTelemetry-native LLM tracing, evals, datasets. Arize commercial offers Phoenix + Surveyor.
Active · Verified 2026-10-27 · fresh as of 2026-10-27 · 40 cited facts, 1 with a third-party source · 1 recorded change · Suggest a correction
At a glance
- Type
- OSS LLM tracing + eval vendor fix
- Tier
- T1
- Latest release
- v20.26.1 (2026-10-25) registry fix
- License
- Elastic-2.0 repo fix
- Pricing
- searched not found fix
- Funding
- searched not found fix
- Freshness
- 2026-10-27 fix
- Layer
- agent-infra repo fix
- Licensing
- commercial repo fix
- SDK languages
- python, rest, typescript vendor fix
- Protocols
- mcp-server, opentelemetry repo fix
- Developer activity
- OpenRank 36.23 (12-mo avg 41.52) · 128 participants — 2026-09 third-party fix
When to use
Optimised for: searched not found
Anti-fit: searched not found
Pros & cons
Pros
searched not found
Cons
searched not found
Claims & capabilities
OSS LLM-observability tool by Arize; Apache-2.0; companion to Arize commercial platform.
Technical surface
- API surface
- Python SDK, TypeScript SDK, REST API (OpenAPI), GraphQL API, CLI (phoenix-cli)
- Backend storage
- not applicable — not a memory product
- Deployment
- searched not found
- Embedding model
- not applicable — not a memory product
- Multi-tenancy
- searched not found
- MCP
- yes — built-in remote MCP server at /mcp; legacy stdio @arizeai/phoenix-mcp in maintenance
- A2A
- searched not found
- OpenTelemetry
- searched not found
Compare Arize Phoenix with…
Similar systems
Other evaluation & observability platforms in the catalog, ranked by inbound references.
- Arize AI T1
Production ML monitoring + LLM observability (Arize AX) — drift, eval, root-cause. Pre-LLM observability leader; now LLM-pivoted.
- Braintrust T1
Eval-first LLM platform — datasets, eval runs, prompt playground, tracing. Founded by ex-Impira (acquired by Dropbox) team. Used by Notion, Brex, AirOps.
- Confident AI / DeepEval T2
Open-source DeepEval framework + Confident AI cloud — pytest-style eval runs, hallucination/relevance/bias metrics, datasets.
- OpenLLMetry (Traceloop) T2
Traceloop's open-source OpenTelemetry auto-instrumentation for LLM workflows — works with any OTel-compatible backend (Datadog, New Relic, Grafana, etc.).
- Helicone T2
Open-source LLM observability and AI gateway — one-line proxy integration captures every LLM call; sessions, custom properties, evals. Acquired by Mintlify in Mar 2026 and placed in maintenance mode; helicone.ai now states it is no longer part of Mintlify.
- Ragas T2
Open-source eval framework for RAG pipelines — faithfulness, answer-relevance, context-precision, context-recall. Widely used as a baseline RAG eval kit.
Sources (39 cited facts, 1 third-party)
Each fact links to the page it came from; the badge says who published it (how to read sources).
- What it is OSS LLM tracing + eval vendor
- What it does & what's distinct Arize AI's open-source LLM observability tool — OpenTelemetry-native LLM tracing, evals,… vendor
- Claims / benefits OSS LLM-observability tool by Arize; Apache-2.0; companion to Arize commercial platform. repo
- Created 2023 repo
- Latest release v20.26.1 (2026-10-25) registry
- License Elastic-2.0 repo
- GitHub Arize-ai/phoenix — ~12.0k stars, last commit 2026-10 repo
- Founders / pedigree Jason Lopatecki (ex-TubeMogul) vendor
- API surface Python SDK, TypeScript SDK, REST API (OpenAPI), GraphQL API, CLI (phoenix-cli) repo
- MCP support yes — built-in remote MCP server at /mcp; legacy stdio @arizeai/phoenix-mcp in maintenance repo
- obs-langsmith no vendor
- obs-opentelemetry yes vendor
- obs-datadog no vendor
- obs-helicone no vendor
- obs-weave no vendor
- obs-langfuse no vendor
- obs-arize yes vendor
- obs-custom Phoenix IS an observability platform (OpenInference / OTLP-native) vendor
- cost-token-budget no vendor
- cost-prompt-caching no vendor
- cost-semantic-caching no vendor
- cost-batching no vendor
- cost-model-routing no vendor
- cost-streaming-only no vendor
- cost-observability-cost-attribution yes vendor
- eval-langsmith-evals yes vendor
- eval-braintrust no vendor
- eval-weights-and-biases-agent no vendor
- eval-helicone-evals no vendor
- eval-custom-test-harness yes vendor
- eval-human-loop yes vendor
- eval-production-traffic-replay yes vendor
- architecture-deployment-locus hybrid vendor
- licensing-bucket commercial repo
- positioning-platform-vs-product platform repo
- taxonomy-three-layer-rollup agent-infra repo
- developer-activity-opendigger {"activity":411.07,"as_of":"2026-09","openrank_12mo":41.52,"openrank_current":36.23,"par… third-party
- sdk-languages python,rest,typescript vendor
- protocol-support mcp-server,opentelemetry repo
What changed
Changes to this record's lifecycle, licence, release, pricing and hosting facts, from the catalog's git history. Subscribe (Atom)
Related systems
References (44)
- Anthropic Claude (foundation models) integrates with — Arize Phoenix docs have a Anthropic Claude (foundation models) integration page. (verified 2026-10-29)
- AutoGen / AG2 integrates with — Arize Phoenix docs have a AutoGen / AG2 integration page. (verified 2026-10-29)
- BeeAI Framework integrates with — Arize Phoenix docs have a BeeAI Framework integration page. (verified 2026-10-29)
- Claude Agent SDK integrates with — Arize Phoenix docs have a Claude Agent SDK integration page. (verified 2026-10-29)
- Claude Code (Anthropic) integrates with — Arize Phoenix docs have a Claude Code (Anthropic) integration page. (verified 2026-10-29)
- Cohere Command R+ / Command A integrates with — Arize Phoenix docs have a Cohere Command R+ / Command A integration page. (verified 2026-10-29)
- CrewAI integrates with — Arize Phoenix docs have a CrewAI integration page. (verified 2026-10-29)
- Cursor (IDE) integrates with — Arize Phoenix docs have a Cursor (IDE) integration page. (verified 2026-10-29)
- Daytona integrates with — Arize Phoenix docs have a Daytona integration page. (verified 2026-10-29)
- Dify integrates with — Arize Phoenix docs have a Dify integration page. (verified 2026-10-29)
- DSPy integrates with — Arize Phoenix docs have a DSPy integration page. (verified 2026-10-29)
- e2b integrates with — Arize Phoenix docs have a e2b integration page. (verified 2026-10-29)
- Flowise Memory integrates with — Arize Phoenix docs have a Flowise Memory integration page. (verified 2026-10-29)
- GitHub Copilot (Agent Mode) integrates with — Arize Phoenix docs have a GitHub Copilot (Agent Mode) integration page. (verified 2026-10-29)
- Google Agent Development Kit (ADK) integrates with — Arize Phoenix docs have a Google Agent Development Kit (ADK) integration page. (verified 2026-10-29)
- Google Gemini 3 family integrates with — Arize Phoenix docs have a Google Gemini 3 family integration page. (verified 2026-10-29)
- Haystack (framework) integrates with — Arize Phoenix docs have a Haystack (framework) integration page. (verified 2026-10-29)
- Kiro integrates with — Arize Phoenix docs have a Kiro integration page. (verified 2026-10-29)
- LangChain (framework) integrates with — Arize Phoenix docs have a LangChain (framework) integration page. (verified 2026-10-29)
- Langflow integrates with — Arize Phoenix docs have a Langflow integration page. (verified 2026-10-29)
- LangGraph (orchestration) integrates with — Arize Phoenix docs have a LangGraph (orchestration) integration page. (verified 2026-10-29)
- LiteLLM integrates with — Arize Phoenix docs have a LiteLLM integration page. (verified 2026-10-29)
- LlamaIndex (framework) integrates with — Arize Phoenix docs have a LlamaIndex (framework) integration page. (verified 2026-10-29)
- Mastra integrates with — Arize Phoenix docs have a Mastra integration page. (verified 2026-10-29)
- Mistral Large 2 / Mixtral family integrates with — Arize Phoenix docs have a Mistral Large 2 / Mixtral family integration page. (verified 2026-10-29)
- MLflow integrates with — Arize Phoenix docs have a MLflow integration page. (verified 2026-10-29)
- Modal integrates with — Arize Phoenix docs have a Modal integration page. (verified 2026-10-29)
- Model Context Protocol (MCP spec) integrates with — Arize Phoenix docs have a Model Context Protocol (MCP spec) integration page. (verified 2026-10-29)
- OpenAI Agents SDK integrates with — Arize Phoenix docs have a OpenAI Agents SDK integration page. (verified 2026-10-29)
- OpenAI Codex CLI integrates with — Arize Phoenix docs have a OpenAI Codex CLI integration page. (verified 2026-10-29)
- OpenAI GPT family (GPT-5 / GPT-4o / o3 / o4) integrates with — Arize Phoenix docs have a OpenAI GPT family (GPT-5 / GPT-4o / o3 / o4) integration page. (verified 2026-10-29)
- Opencode (SST) integrates with — Arize Phoenix docs have a Opencode (SST) integration page. (verified 2026-10-29)
- OpenRouter integrates with — Arize Phoenix docs have a OpenRouter integration page. (verified 2026-10-29)
- Phidata (now Agno) integrates with — Arize Phoenix docs have a Phidata integration page. (verified 2026-10-29)
- Portkey AI integrates with — Arize Phoenix docs have a Portkey AI integration page. (verified 2026-10-29)
- Pydantic-AI integrates with — Arize Phoenix docs have a Pydantic-AI integration page. (verified 2026-10-29)
- Qdrant integrates with — Arize Phoenix docs have a Qdrant integration page. (verified 2026-10-29)
- Ragas integrates with — Arize Phoenix docs have a Ragas integration page. (verified 2026-10-29)
- Restate integrates with — Arize Phoenix docs have a Restate integration page. (verified 2026-10-29)
- smolagents (Hugging Face) integrates with — Arize Phoenix docs have a smolagents (Hugging Face) integration page. (verified 2026-10-29)
- Spring AI ChatMemory integrates with — Arize Phoenix docs have a Spring AI ChatMemory integration page. (verified 2026-10-29)
- Strands Agents (AWS) integrates with — Arize Phoenix docs have a Strands Agents (AWS) integration page. (verified 2026-10-29)
- Together AI integrates with — Arize Phoenix docs have a Together AI integration page. (verified 2026-10-29)
- Vercel AI SDK integrates with — Arize Phoenix docs have a Vercel AI SDK integration page. (verified 2026-10-29)
Referenced by (17)
- agentgateway integrates with — agentgateway integrations docs have a Arize Phoenix observability page. (verified 2026-10-29)
- AutoGen / AG2 integrates with — AG2 telemetry docs name Arize Phoenix as the open-source path for inspecting AG2 OpenTelemetry traces. (verified 2026-10-29)
- CrewAI integrates with — CrewAI docs have an Arize Phoenix observability integration page. (verified 2026-10-29)
- Dify integrates with — Dify monitoring integration: "Integrate with Phoenix" (tracing). (verified 2026-10-29)
- Google Agent Development Kit (ADK) integrates with — ADK integrations catalog has a "Phoenix observability for ADK" page (Open-source, self-hosted observability, tracing, and evaluation of LLM applications). (verified 2026-10-29)
- Haystack (framework) integrates with — Haystack integrations directory has an Arize Phoenix integration page ("Trace your Haystack pipelines with Arize Phoenix"). (verified 2026-10-29)
- IBM ContextForge MCP Gateway integrates with — IBM ContextForge docs have a Phoenix observability page. (verified 2026-10-29)
- Langflow integrates with — Langflow integration page: Arize Phoenix tracing. (verified 2026-10-29)
- LiteLLM integrates with — LiteLLM docs have an Arize Phoenix logging/observability integration page. (verified 2026-10-29)
- LlamaIndex (framework) integrates with — LlamaIndex has an official callback/observability integration package llama-index-callbacks-arize-phoenix in its repo. (verified 2026-10-29)
- Mastra integrates with — The @mastra/arize exporter README says it exports Mastra traces to Arize Phoenix via OpenInference. (verified 2026-10-29)
- Milvus integrates with — Milvus's integrations overview lists a Milvus + Arize Phoenix integration tutorial. (verified 2026-10-29)
- OpenAI Agents SDK integrates with — OpenAI Agents SDK tracing docs list Arize Phoenix under external tracing processors. (verified 2026-10-29)
- Portkey AI integrates with — Portkey docs have an Arize Phoenix tracing provider integration page. (verified 2026-10-29)
- Restate integrates with — Restate AI docs integration page: Arize Phoenix ecosystem integration. (verified 2026-10-29)
- smolagents (Hugging Face) integrates with — smolagents inspect-runs tutorial has a section on setting up telemetry with Arize Phoenix. (verified 2026-10-29)
- Weaviate integrates with — Weaviate's integrations / model-provider docs list Arize Phoenix as an integration. (verified 2026-10-29)