OpenInference

https://github.com/Arize-ai/openinference

Arize-led open OTel semantic conventions for LLM/agent tracing — auto-instrumentation for OpenAI/Anthropic/LangChain/LlamaIndex etc.

Active · Verified 2026-10-27 · fresh as of 2026-10-27 · 20 cited facts, 1 with a third-party source · 1 recorded change · Suggest a correction

At a glance

Tier
T2
Created
2023 repo fix
License
Apache-2.0 repo fix
Pricing
searched not found fix
Funding
searched not found fix
Freshness
2026-10-27 fix
Layer
agent-infra repo fix
Licensing
open-source repo fix
Deployment locus
local repo fix
Platform vs product
platform repo fix
Protocols
opentelemetry repo fix

When to use

Optimised for: searched not found

Anti-fit: searched not found

Pros & cons

Pros

searched not found

Cons

searched not found

Claims & capabilities

OSS OpenTelemetry-based instrumentation for LLM apps; Apache-2.0; companion to Arize Phoenix.

Technical surface

API surface
Python and JS/TS OpenTelemetry instrumentation packages
Backend storage
not applicable — not a memory product
Deployment
Self-hosted only — library
Embedding model
not applicable — not a memory product
Multi-tenancy
searched not found
MCP
searched not found
A2A
searched not found
OpenTelemetry
searched not found

Similar systems

Other evaluation & observability platforms in the catalog, ranked by inbound references.

  • Arize Phoenix T1

    Arize AI's open-source LLM observability tool — OpenTelemetry-native LLM tracing, evals, datasets. Arize commercial offers Phoenix + Surveyor.

  • Arize AI T1

    Production ML monitoring + LLM observability (Arize AX) — drift, eval, root-cause. Pre-LLM observability leader; now LLM-pivoted.

  • Braintrust T1

    Eval-first LLM platform — datasets, eval runs, prompt playground, tracing. Founded by ex-Impira (acquired by Dropbox) team. Used by Notion, Brex, AirOps.

  • Confident AI / DeepEval T2

    Open-source DeepEval framework + Confident AI cloud — pytest-style eval runs, hallucination/relevance/bias metrics, datasets.

  • OpenLLMetry (Traceloop) T2

    Traceloop's open-source OpenTelemetry auto-instrumentation for LLM workflows — works with any OTel-compatible backend (Datadog, New Relic, Grafana, etc.).

  • Helicone T2

    Open-source LLM observability and AI gateway — one-line proxy integration captures every LLM call; sessions, custom properties, evals. Acquired by Mintlify in Mar 2026 and placed in maintenance mode; helicone.ai now states it is no longer part of Mintlify.

Sources (19 cited facts, 1 third-party)

Each fact links to the page it came from; the badge says who published it (how to read sources).

What changed

Changes to this record's lifecycle, licence, release, pricing and hosting facts, from the catalog's git history. Subscribe (Atom)

  1. 2026-10-27
    • Latest release first recorded as “v0.1.42 (2026-10-23) — openinference-semantic-conventions” source
    • Deployment first recorded as “Self-hosted only — library” source
    #272

Related systems

References (27)

  • Anthropic Claude (foundation models) integrates with — The OpenInference repo README lists an OpenInference instrumentation package for Anthropic Claude (foundation models). (verified 2026-10-29)
  • AutoGen / AG2 integrates with — The OpenInference repo README lists an OpenInference instrumentation package for AutoGen / AG2. (verified 2026-10-29)
  • BeeAI Framework integrates with — The OpenInference repo README lists an OpenInference instrumentation package for BeeAI Framework. (verified 2026-10-29)
  • Claude Agent SDK integrates with — The OpenInference repo README lists an OpenInference instrumentation package for Claude Agent SDK. (verified 2026-10-29)
  • Cohere Command R+ / Command A integrates with — The OpenInference repo README lists an OpenInference instrumentation package for Cohere Command R+ / Command A. (verified 2026-10-29)
  • CrewAI integrates with — The OpenInference repo README lists an OpenInference instrumentation package for CrewAI. (verified 2026-10-29)
  • DSPy integrates with — The OpenInference repo README lists an OpenInference instrumentation package for DSPy. (verified 2026-10-29)
  • Google Agent Development Kit (ADK) integrates with — The OpenInference repo README lists an OpenInference instrumentation package for Google Agent Development Kit (ADK). (verified 2026-10-29)
  • Google Gemini 3 family integrates with — The OpenInference repo README lists an OpenInference instrumentation package for Google Gemini 3 family. (verified 2026-10-29)
  • Haystack (framework) integrates with — The OpenInference repo README lists an OpenInference instrumentation package for Haystack (framework). (verified 2026-10-29)
  • LangChain (framework) integrates with — The OpenInference repo README lists an OpenInference instrumentation package for LangChain (framework). (verified 2026-10-29)
  • LiteLLM integrates with — The OpenInference repo README lists an OpenInference instrumentation package for LiteLLM. (verified 2026-10-29)
  • LlamaIndex (framework) integrates with — The OpenInference repo README lists an OpenInference instrumentation package for LlamaIndex (framework). (verified 2026-10-29)
  • Mistral Large 2 / Mixtral family integrates with — The OpenInference repo README lists an OpenInference instrumentation package for Mistral Large 2 / Mixtral family. (verified 2026-10-29)
  • Model Context Protocol (MCP spec) integrates with — The OpenInference repo README lists an OpenInference instrumentation package for Model Context Protocol (MCP spec). (verified 2026-10-29)
  • OpenAI Agents SDK integrates with — The OpenInference repo README lists an OpenInference instrumentation package for OpenAI Agents SDK. (verified 2026-10-29)
  • OpenAI GPT family (GPT-5 / GPT-4o / o3 / o4) integrates with — The OpenInference repo README lists an OpenInference instrumentation package for OpenAI GPT family (GPT-5 / GPT-4o / o3 / o4). (verified 2026-10-29)
  • OpenLLMetry (Traceloop) integrates with — The OpenInference repo README lists an OpenInference instrumentation package for OpenLLMetry (Traceloop). (verified 2026-10-29)
  • Phidata (now Agno) integrates with — The OpenInference repo README lists an OpenInference instrumentation package for Phidata. (verified 2026-10-29)
  • Pipecat (Daily) integrates with — The OpenInference repo README lists an OpenInference instrumentation package for Pipecat (Daily). (verified 2026-10-29)
  • Portkey AI integrates with — The OpenInference repo README lists an OpenInference instrumentation package for Portkey AI. (verified 2026-10-29)
  • Pydantic-AI integrates with — The OpenInference repo README lists an OpenInference instrumentation package for Pydantic-AI. (verified 2026-10-29)
  • smolagents (Hugging Face) integrates with — The OpenInference repo README lists an OpenInference instrumentation package for smolagents (Hugging Face). (verified 2026-10-29)
  • Spring AI ChatMemory integrates with — The OpenInference repo README lists an OpenInference instrumentation package for Spring AI ChatMemory. (verified 2026-10-29)
  • Strands Agents (AWS) integrates with — The OpenInference repo README lists an OpenInference instrumentation package for Strands Agents (AWS). (verified 2026-10-29)
  • Together AI integrates with — The OpenInference repo README lists an OpenInference instrumentation package for Together AI. (verified 2026-10-29)
  • Vercel AI SDK integrates with — The OpenInference repo README lists an OpenInference instrumentation package for Vercel AI SDK. (verified 2026-10-29)

Referenced by (5)

  • Arthur Engine integrates with — Arthur Engine README: collects and analyzes OpenInference OpenTelemetry traces from agentic workflows. (verified 2026-10-29)
  • LangChain (framework) integrates with — LangChain docs have an OpenInference integration provider page (OpenTelemetry instrumentation that records LangChain and LangGraph operations using OpenInference semantic conventions). (verified 2026-10-29)
  • Langfuse integrates with — Langfuse's integrations directory has a OpenInference integration page. (verified 2026-10-29)
  • LlamaIndex (framework) integrates with — LlamaIndex has an official callback/observability integration package llama-index-callbacks-openinference in its repo. (verified 2026-10-29)
  • Pipecat (Daily) integrates with — Pipecat docs have a OpenInference service page. (verified 2026-10-29)