Catalog Systems Evaluation & observability platforms TruLens

TruLens

https://github.com/truera/trulens

Open-source LLM/RAG evaluation framework — feedback functions, the RAG Triad. Originally TruEra; now Snowflake-stewarded.

Active · Verified 2026-10-29 · fresh as of 2026-10-29 · 21 cited facts, 1 with a third-party source · 1 recorded change · Suggest a correction

At a glance

Type
LLM eval framework repo fix
Tier
T2
Section
Evaluation & observability platforms
Created
2023 repo fix
Latest release
v2.16.0 (2026-10-19) — trulens registry fix
License
MIT repo fix
GitHub
truera/trulens — ~3.6k stars, last commit 2026-10 repo fix
Pricing
searched not found fix
Funding
searched not found fix
Freshness
2026-10-29 fix
Layer
agent-infra repo fix
Licensing
open-source repo fix
Deployment locus
local repo fix
Platform vs product
platform repo fix
Maturity
alpha registry fix
SDK languages
python repo fix
Protocols
opentelemetry repo fix
Developer activity
OpenRank 6.19 (12-mo avg 8.74) · 43 participants — 2026-09 third-party fix

When to use

Optimised for: searched not found

Anti-fit: searched not found

Pros & cons

Pros

searched not found

Cons

searched not found

Claims & capabilities

OSS LLM-eval framework by TruEra (now Snowflake); MIT.

Technical surface

API surface
Python SDK (trulens plus provider and app-integration packages); OpenTelemetry-native tracing exportable to OTLP backends
Backend storage
not applicable — not a memory product
Deployment
Self-hosted only — library
Embedding model
not applicable — not a memory product
Multi-tenancy
searched not found
MCP
yes — instruments MCP tool calls via the MCP span type (tool name, arguments, output, latency)
A2A
searched not found
OpenTelemetry
searched not found

Similar systems

Other evaluation & observability platforms in the catalog, ranked by inbound references.

  • Arize Phoenix T1

    Arize AI's open-source LLM observability tool — OpenTelemetry-native LLM tracing, evals, datasets. Arize commercial offers Phoenix + Surveyor.

  • Arize AI T1

    Production ML monitoring + LLM observability (Arize AX) — drift, eval, root-cause. Pre-LLM observability leader; now LLM-pivoted.

  • Braintrust T1

    Eval-first LLM platform — datasets, eval runs, prompt playground, tracing. Founded by ex-Impira (acquired by Dropbox) team. Used by Notion, Brex, AirOps.

  • Confident AI / DeepEval T2

    Open-source DeepEval framework + Confident AI cloud — pytest-style eval runs, hallucination/relevance/bias metrics, datasets.

  • OpenLLMetry (Traceloop) T2

    Traceloop's open-source OpenTelemetry auto-instrumentation for LLM workflows — works with any OTel-compatible backend (Datadog, New Relic, Grafana, etc.).

  • Helicone T2

    Open-source LLM observability and AI gateway — one-line proxy integration captures every LLM call; sessions, custom properties, evals. Acquired by Mintlify in Mar 2026 and placed in maintenance mode; helicone.ai now states it is no longer part of Mintlify.

Sources (20 cited facts, 1 third-party)

Each fact links to the page it came from; the badge says who published it (how to read sources).

What changed

Changes to this record's lifecycle, licence, release, pricing and hosting facts, from the catalog's git history. Subscribe (Atom)

  1. 2026-10-27
    • Latest release first recorded as “v2.16.0 (2026-10-19) — trulens” source
    • Deployment first recorded as “Self-hosted only — library” source
    • MCP support first recorded as “yes — instruments MCP tool calls via the MCP span type (tool name, arguments, output, latency)” source
    #272

Related systems

Referenced by (3)

  • LangChain (framework) integrates with — LangChain docs have a TrueLens integration provider page (Evaluation framework for LLM applications). (verified 2026-10-29)
  • Pinecone integrates with — Pinecone's integrations directory has a TruLens integration page. (verified 2026-10-29)
  • Weaviate integrates with — Weaviate's integrations / model-provider docs list TruLens as an integration. (verified 2026-10-29)