Humanloop
Collaborative LLM development platform — prompt editor, evals, tracing. UK; Index Ventures + Y Combinator backed. The team joined Anthropic in 2025 and the platform shut down on 2025-09-08.
Archived · Verified 2026-10-29 · fresh as of 2026-10-29 · 14 cited facts, 4 with a third-party source · 1 recorded change · Suggest a correction
At a glance
- Type
- LLM eval + collab vendor fix
- Tier
- T2
- Latest release
- v0.8.38 (2025-05-09) — humanloop SDK, final registry fix
- License
- searched not found fix
- Pricing
- searched not found fix
- Funding
- $5.6M total: $2.8M seed 2023 (Index Ventures + YC W21). third-party fix
- Freshness
- 2026-10-29 fix
- Layer
- agent-infra repo fix
- Developer activity
- OpenRank 2.79 (12-mo avg 4.02) · 1 participants — 2025-07 third-party fix
When to use
Optimised for: searched not found
Anti-fit: searched not found
Pros & cons
Pros
searched not found
Cons
searched not found
Claims & capabilities
$2.8M seed (Index, YC W21).
Technical surface
- API surface
- searched not found
- Backend storage
- not applicable — not a memory product
- Deployment
- searched not found
- Embedding model
- not applicable — not a memory product
- Multi-tenancy
- searched not found
- MCP
- searched not found
- A2A
- searched not found
- OpenTelemetry
- searched not found
Similar systems
Other evaluation & observability platforms in the catalog, ranked by inbound references.
- Arize Phoenix T1
Arize AI's open-source LLM observability tool — OpenTelemetry-native LLM tracing, evals, datasets. Arize commercial offers Phoenix + Surveyor.
- Arize AI T1
Production ML monitoring + LLM observability (Arize AX) — drift, eval, root-cause. Pre-LLM observability leader; now LLM-pivoted.
- Braintrust T1
Eval-first LLM platform — datasets, eval runs, prompt playground, tracing. Founded by ex-Impira (acquired by Dropbox) team. Used by Notion, Brex, AirOps.
- Confident AI / DeepEval T2
Open-source DeepEval framework + Confident AI cloud — pytest-style eval runs, hallucination/relevance/bias metrics, datasets.
- OpenLLMetry (Traceloop) T2
Traceloop's open-source OpenTelemetry auto-instrumentation for LLM workflows — works with any OTel-compatible backend (Datadog, New Relic, Grafana, etc.).
- Helicone T2
Open-source LLM observability and AI gateway — one-line proxy integration captures every LLM call; sessions, custom properties, evals. Acquired by Mintlify in Mar 2026 and placed in maintenance mode; helicone.ai now states it is no longer part of Mintlify.
Sources (13 cited facts, 4 third-party)
Each fact links to the page it came from; the badge says who published it (how to read sources).
- What it is LLM eval + collab vendor
- What it does & what's distinct Collaborative LLM development platform — prompt editor, evals, tracing. UK; Index Ventur… vendor
- Claims / benefits $2.8M seed (Index, YC W21). vendor
- Created 2020 vendor
- Latest release v0.8.38 (2025-05-09) — humanloop SDK, final registry
- GitHub humanloop/humanloop-python — ~12 stars, last commit 2025-05 repo
- Funding $5.6M total: $2.8M seed 2023 (Index Ventures + YC W21). third-party
- Customers / scale Duolingo, Gusto, Vanta, AmexGBT, Mendel; LLM eval + prompt management. vendor
- HQ London, UK. third-party
- Founders / pedigree Raza Habib (CEO; ex-DeepMind), Peter Hayes, Jordan Burgess; founded 2020 (YC W21). vendor
- adoption-accelerator yc-s20 third-party
- taxonomy-three-layer-rollup agent-infra repo
- developer-activity-opendigger {"activity":1.49,"as_of":"2025-07","openrank_12mo":4.02,"openrank_current":2.79,"partici… third-party
What changed
Changes to this record's lifecycle, licence, release, pricing and hosting facts, from the catalog's git history. Subscribe (Atom)
Related systems
Referenced by (1)
- LiteLLM integrates with — LiteLLM docs have a Humanloop logging/observability integration page. (verified 2026-10-29)