OpenLLMetry (Traceloop)
https://github.com/traceloop/openllmetry
Traceloop's open-source OpenTelemetry auto-instrumentation for LLM workflows — works with any OTel-compatible backend (Datadog, New Relic, Grafana, etc.).
Active · Verified 2026-10-27 · fresh as of 2026-10-27 · 22 cited facts, 1 with a third-party source · 1 recorded change · Suggest a correction
At a glance
- Type
- OTel auto-instrumentation for LLMs repo fix
- Tier
- T2
- Latest release
- v0.62.4 (2026-09-29) — traceloop-sdk registry fix
- License
- Apache-2.0 repo fix
- Pricing
- searched not found fix
- Funding
- Traceloop raised $6.3M seed 2024 (Sorenson Capital led). vendor fix
- Freshness
- 2026-10-27 fix
- Layer
- agent-infra repo fix
- Licensing
- open-source repo fix
- Protocols
- opentelemetry repo fix
- Developer activity
- OpenRank 8.48 (12-mo avg 12.76) · 69 participants — 2026-09 third-party fix
When to use
Optimised for: searched not found
Anti-fit: searched not found
Pros & cons
Pros
searched not found
Cons
searched not found
Claims & capabilities
searched not found
Technical surface
- API surface
- Python SDK (traceloop-sdk); JS/TS SDK in openllmetry-js
- Backend storage
- not applicable — not a memory product
- Deployment
- Self-hosted only — library
- Embedding model
- not applicable — not a memory product
- Multi-tenancy
- searched not found
- MCP
- searched not found
- A2A
- searched not found
- OpenTelemetry
- searched not found
Similar systems
Other evaluation & observability platforms in the catalog, ranked by inbound references.
- Arize Phoenix T1
Arize AI's open-source LLM observability tool — OpenTelemetry-native LLM tracing, evals, datasets. Arize commercial offers Phoenix + Surveyor.
- Arize AI T1
Production ML monitoring + LLM observability (Arize AX) — drift, eval, root-cause. Pre-LLM observability leader; now LLM-pivoted.
- Braintrust T1
Eval-first LLM platform — datasets, eval runs, prompt playground, tracing. Founded by ex-Impira (acquired by Dropbox) team. Used by Notion, Brex, AirOps.
- Confident AI / DeepEval T2
Open-source DeepEval framework + Confident AI cloud — pytest-style eval runs, hallucination/relevance/bias metrics, datasets.
- Helicone T2
Open-source LLM observability and AI gateway — one-line proxy integration captures every LLM call; sessions, custom properties, evals. Acquired by Mintlify in Mar 2026 and placed in maintenance mode; helicone.ai now states it is no longer part of Mintlify.
- Ragas T2
Open-source eval framework for RAG pipelines — faithfulness, answer-relevance, context-precision, context-recall. Widely used as a baseline RAG eval kit.
Sources (21 cited facts, 1 third-party)
Each fact links to the page it came from; the badge says who published it (how to read sources).
- What it is OTel auto-instrumentation for LLMs repo
- What it does & what's distinct Traceloop's open-source OpenTelemetry auto-instrumentation for LLM workflows — works wit… repo
- Created 2023 repo
- Latest release v0.62.4 (2026-09-29) — traceloop-sdk registry
- License Apache-2.0 repo
- GitHub traceloop/openllmetry — ~7.5k stars, last commit 2026-10 repo
- Funding Traceloop raised $6.3M seed 2024 (Sorenson Capital led). vendor
- Deployment Self-hosted only — library repo
- HQ US/IL repo
- Founders / pedigree Nir Gazit (CEO; ex-Fiverr), Gal Kleinman; founded 2023. vendor
- Code/weights release Active — last commit 2026-05 · 7,096★ repo
- API surface Python SDK (traceloop-sdk); JS/TS SDK in openllmetry-js registry
- commit-trajectory [{"ym":"2024-03","cum":461},{"ym":"2024-04","cum":577},{"ym":"2024-05","cum":688},{"ym":… repo
- download-trajectory [{"ym":"2025-11","monthly":664921,"cum":664921},{"ym":"2025-12","monthly":2174675,"cum":… registry
- architecture-deployment-locus local repo
- licensing-bucket open-source repo
- positioning-platform-vs-product platform repo
- taxonomy-three-layer-rollup agent-infra repo
- developer-activity-opendigger {"activity":144.08,"as_of":"2026-09","openrank_12mo":12.76,"openrank_current":8.48,"part… third-party
- sdk-languages python repo
- protocol-support opentelemetry repo
What changed
Changes to this record's lifecycle, licence, release, pricing and hosting facts, from the catalog's git history. Subscribe (Atom)
Related systems
References (29)
- Anthropic Claude (foundation models) integrates with — OpenLLMetry's What's Supported page lists Anthropic Claude (foundation models) as instrumented out of the box. (verified 2026-10-29)
- AWS SageMaker integrates with — OpenLLMetry's What's Supported page lists AWS SageMaker as instrumented out of the box. (verified 2026-10-29)
- Braintrust integrates with — OpenLLMetry docs have a page on exporting traces to Braintrust. (verified 2026-10-29)
- Burr (DAGWorks) integrates with — OpenLLMetry's What's Supported page lists Burr (DAGWorks) as instrumented out of the box. (verified 2026-10-29)
- Chroma integrates with — OpenLLMetry's What's Supported page lists Chroma as instrumented out of the box. (verified 2026-10-29)
- Cohere Command R+ / Command A integrates with — OpenLLMetry's What's Supported page lists Cohere Command R+ / Command A as instrumented out of the box. (verified 2026-10-29)
- CrewAI integrates with — OpenLLMetry's What's Supported page lists CrewAI as instrumented out of the box. (verified 2026-10-29)
- Elasticsearch integrates with — OpenLLMetry's What's Supported page lists Elasticsearch as instrumented out of the box. (verified 2026-10-29)
- Google Gemini 3 family integrates with — OpenLLMetry's What's Supported page lists Google Gemini 3 family as instrumented out of the box. (verified 2026-10-29)
- Haystack (framework) integrates with — OpenLLMetry's What's Supported page lists Haystack (framework) as instrumented out of the box. (verified 2026-10-29)
- LanceDB integrates with — OpenLLMetry's What's Supported page lists LanceDB as instrumented out of the box. (verified 2026-10-29)
- LangChain (framework) integrates with — OpenLLMetry's What's Supported page lists LangChain (framework) as instrumented out of the box. (verified 2026-10-29)
- Langfuse integrates with — OpenLLMetry docs have a page on exporting traces to Langfuse. (verified 2026-10-29)
- LangSmith integrates with — OpenLLMetry docs have a page on exporting traces to LangSmith. (verified 2026-10-29)
- LiteLLM integrates with — OpenLLMetry's What's Supported page lists LiteLLM as instrumented out of the box. (verified 2026-10-29)
- LlamaIndex (framework) integrates with — OpenLLMetry's What's Supported page lists LlamaIndex (framework) as instrumented out of the box. (verified 2026-10-29)
- Marqo integrates with — OpenLLMetry's What's Supported page lists Marqo as instrumented out of the box. (verified 2026-10-29)
- Milvus integrates with — OpenLLMetry's What's Supported page lists Milvus as instrumented out of the box. (verified 2026-10-29)
- Mistral Large 2 / Mixtral family integrates with — OpenLLMetry's What's Supported page lists Mistral Large 2 / Mixtral family as instrumented out of the box. (verified 2026-10-29)
- OpenAI Agents SDK integrates with — OpenLLMetry's What's Supported page lists OpenAI Agents SDK as instrumented out of the box. (verified 2026-10-29)
- OpenAI GPT family (GPT-5 / GPT-4o / o3 / o4) integrates with — OpenLLMetry's What's Supported page lists OpenAI GPT family (GPT-5 / GPT-4o / o3 / o4) as instrumented out of the box. (verified 2026-10-29)
- pgvector integrates with — OpenLLMetry's What's Supported page lists pgvector as instrumented out of the box. (verified 2026-10-29)
- Phidata (now Agno) integrates with — OpenLLMetry's What's Supported page lists Phidata as instrumented out of the box. (verified 2026-10-29)
- Pinecone integrates with — OpenLLMetry's What's Supported page lists Pinecone as instrumented out of the box. (verified 2026-10-29)
- Qdrant integrates with — OpenLLMetry's What's Supported page lists Qdrant as instrumented out of the box. (verified 2026-10-29)
- Replicate integrates with — OpenLLMetry's What's Supported page lists Replicate as instrumented out of the box. (verified 2026-10-29)
- Strands Agents (AWS) integrates with — OpenLLMetry's What's Supported page lists Strands Agents (AWS) as instrumented out of the box. (verified 2026-10-29)
- Together AI integrates with — OpenLLMetry's What's Supported page lists Together AI as instrumented out of the box. (verified 2026-10-29)
- Weaviate integrates with — OpenLLMetry's What's Supported page lists Weaviate as instrumented out of the box. (verified 2026-10-29)
Referenced by (11)
- Braintrust integrates with — Braintrust docs have a OpenLLMetry (Traceloop) integration page. (verified 2026-10-29)
- Chroma integrates with — Chroma's docs have a OpenLLMetry (Traceloop) integration page. (verified 2026-10-29)
- Haystack (framework) integrates with — Haystack integrations directory has a Traceloop integration page ("Evaluate and monitor the quality of your LLM apps and agents"). (verified 2026-10-29)
- Langflow integrates with — Langflow integration page: Instana/Traceloop (OpenLLMetry) tracing. (verified 2026-10-29)
- Langfuse integrates with — Langfuse's integrations directory has a OpenLLMetry (Traceloop) integration page. (verified 2026-10-29)
- OpenInference integrates with — The OpenInference repo README lists an OpenInference instrumentation package for OpenLLMetry (Traceloop). (verified 2026-10-29)
- Pinecone integrates with — Pinecone's integrations directory has a OpenLLMetry (Traceloop) integration page. (verified 2026-10-29)
- Portkey AI integrates with — Portkey docs have a Traceloop (OpenLLMetry) tracing provider integration page. (verified 2026-10-29)
- Qdrant integrates with — Qdrant's documentation has a OpenLLMetry (Traceloop) integration page. (verified 2026-10-29)
- TrueFoundry AI Gateway integrates with — TrueFoundry AI Gateway ecosystem lists a Traceloop integration page. (verified 2026-10-29)
- Vercel AI SDK integrates with — AI SDK docs have a Traceloop observability integration page. (verified 2026-10-29)