Patronus AI

https://www.patronus.ai/

Enterprise eval and guardrails platform — Lynx hallucination detector (open weights), Glider judge model, Polyglot benchmark. Built by ex-Meta researchers. The evaluation platform (API, SDKs, evaluators, Lynx, GLIDER, Percival) has been discontinued per its docs (checked 2026-10-29); Patronus AI now operates as a behavioral research lab building training data and simulated environments for agents.

Archived. repository archived (read-only) Source

Archived · Verified 2026-10-29 · fresh as of 2026-10-29 · 14 cited facts, 0 with a third-party source · 2 recorded changes · Suggest a correction

At a glance

Tier
T2
Created
2023 vendor fix
Latest release
v0.1.26 (2026-09-17) — patronus registry fix
GitHub
searched not found vendor fix
Freshness
2026-10-29 fix
Layer
agent-infra repo fix
Licensing
commercial registry fix

When to use

Optimised for: searched not found

Anti-fit: searched not found

Pros & cons

Pros

searched not found

Cons

searched not found

Claims & capabilities

$50M Series A 2024 (Notable Capital led).

Technical surface

API surface
Python SDK
Backend storage
not applicable — not a memory product
Deployment
searched not found
Embedding model
not applicable — not a memory product
Multi-tenancy
searched not found
MCP
searched not found
A2A
searched not found
OpenTelemetry
searched not found

Similar systems

Other evaluation & observability platforms in the catalog, ranked by inbound references.

  • Arize Phoenix T1

    Arize AI's open-source LLM observability tool — OpenTelemetry-native LLM tracing, evals, datasets. Arize commercial offers Phoenix + Surveyor.

  • Arize AI T1

    Production ML monitoring + LLM observability (Arize AX) — drift, eval, root-cause. Pre-LLM observability leader; now LLM-pivoted.

  • Braintrust T1

    Eval-first LLM platform — datasets, eval runs, prompt playground, tracing. Founded by ex-Impira (acquired by Dropbox) team. Used by Notion, Brex, AirOps.

  • Confident AI / DeepEval T2

    Open-source DeepEval framework + Confident AI cloud — pytest-style eval runs, hallucination/relevance/bias metrics, datasets.

  • OpenLLMetry (Traceloop) T2

    Traceloop's open-source OpenTelemetry auto-instrumentation for LLM workflows — works with any OTel-compatible backend (Datadog, New Relic, Grafana, etc.).

  • Helicone T2

    Open-source LLM observability and AI gateway — one-line proxy integration captures every LLM call; sessions, custom properties, evals. Acquired by Mintlify in Mar 2026 and placed in maintenance mode; helicone.ai now states it is no longer part of Mintlify.

Sources (13 cited facts, 0 third-party)

Each fact links to the page it came from; the badge says who published it (how to read sources).

What changed

Changes to this record's lifecycle, licence, release, pricing and hosting facts, from the catalog's git history. Subscribe (Atom)

  1. 2026-10-29
    • Lifecycle first recorded as “archived”
    #305
  2. 2026-10-27
    • License first recorded as “proprietary; Python SDK MIT” source
    • Latest release first recorded as “v0.1.26 (2026-09-17) — patronus” source
    • Pricing first recorded as “Contact sales — no public price list” source
    #272

Related systems

Referenced by (7)

  • Bifrost (Maxim AI) integrates with — Bifrost guardrails integrations include Patronus AI. (verified 2026-10-29)
  • CrewAI integrates with — CrewAI docs have a Patronus AI evaluation observability integration page. (verified 2026-10-29)
  • NVIDIA NeMo Guardrails integrates with — NeMo Guardrails docs have a Patronus Lynx third-party guardrail page. (verified 2026-10-29)
  • Portkey AI integrates with — Portkey docs have a Patronus AI guardrails integration page. (verified 2026-10-29)
  • TrueFoundry AI Gateway integrates with — TrueFoundry AI Gateway ecosystem lists a Patronus integration page. (verified 2026-10-29)
  • Vercel AI SDK integrates with — AI SDK docs have a Patronus observability integration page. (verified 2026-10-29)
  • Weaviate integrates with — Weaviate's integrations / model-provider docs list Patronus AI as an integration. (verified 2026-10-29)