LangSmith
https://www.langchain.com/langsmith
Memory reads, vector DB retrievals, state changes are distinct span types in traces. RAG eval separates retrieval quality (context precision) from generation quality (faithfulness). Dataset versioning guards against eval drift.
Active · Verified 2026-10-23 · fresh as of 2026-10-23 · 46 cited facts, 1 with a third-party source · 2 recorded changes · Suggest a correction
At a glance
- Type
- Memory mutations as distinct span types vendor fix
- Tier
- T1
- Latest release
- SDK v0.14.11 (2026-10-16) — platform itself proprietary registry fix
- License
- not applicable — not OSS fix
- GitHub
- not applicable — no GitHub repo fix
- Pricing
- Developer: free (5K traces/mo); Plus: $39/seat/mo (10K traces); Enterprise: custom (SSO/SAML; dedicated support) vendor fix
- Funding
- LangChain total ~$160M ($10M seed Benchmark 2023; $25M Series A Sequoia Feb 2024 at $200M post-money; $125M Oct 2025 round at $1.25B valuation) third-party fix
- Freshness
- 2026-10-23 fix
- Layer
- agent-infra repo fix
- Licensing
- commercial vendor fix
- SDK languages
- python, rest, typescript repo fix
- Protocols
- mcp-server, opentelemetry vendor fix
- Compliance
- gdpr, hipaa, iso27001, iso42001, soc2-type2 vendor fix
Memory taxonomy
- storage
- relational
- retrieval
- exact-match
- persistence
- long-term
- update
- append-only
- unit
- episode
- governance
- auditable
- conflict
- n/a
When to use
Optimised for: memory operation tracing + drift / poisoning detection
Anti-fit: not for use cases that don't run agent workloads in production
Pros & cons
Pros
Best integration with the LangChain / LangGraph stack — debug memory + chain + agent in one trace; the de-facto trace tool for that ecosystem.
Cons
LangChain-shaped — works less well outside that ecosystem; closed SaaS.
Claims & capabilities
Free 5k traces/month Developer; Plus $39/mo; Enterprise custom. No automated drift / poisoning detection.
Technical surface
- API surface
- REST, SDK: Python, JS/TS
- Backend storage
- custom (LangChain-managed)
- Deployment
- SaaS cloud (US); Enterprise: dedicated tenant
- Embedding model
- not applicable — observability product
- Multi-tenancy
- namespace (workspace/project)
- MCP
- via LangChain MCP adapters
- A2A
- no data — searched langchain.com/langsmith, docs.smith.langchain.com, docs.smith.langchain.com/observability/concepts; A2A protocol not advertised (OTel-based traces, webhook automations)
- OpenTelemetry
- first-class — OTel ingestion + export
Compare LangSmith with…
Alternatives to LangSmith → live options ranked by shared design, licence, hosting and MCP support
Similar systems
Other memory observability & monitoring in the catalog, ranked by inbound references.
- Langfuse T1
Acquired by ClickHouse (2026-01-16); product and MIT-licensed repo continue under the Langfuse name. Memory module reads/writes captured as named spans. Trace Log View concatenates every agent step including memory ops. Agent Graphs (GA 2025) infer graph structure from observation nesting; session-level replay tracks how memory state evolves.
- AgentOps T2
When Mem0 is connected, gains Memory Operation Timeline, Search Analytics, Memory Growth tracking, Error Tracking per memory call. Standalone, records context at each step but doesn't analyse memory quality.
- Galileo (galileo.ai) (now Splunk Agent Observability) T1
Acquired by Cisco (announced 2026-04-09, closed by 2026-05); now Splunk Agent Observability. Treats memory as first-class in multi-agent tracing. Luna-2 SLMs (3B / 8B) scan every interaction for intent drift and belief drift; 20+ checks at sub-200ms latency. Catches when agent A's view of the world splits from teammate B's. OpenTelemetry-compatible.
- Ratine T2
Only tool found that scans the persistent memory layer on disk rather than runtime tracing. Detects injected instructions, obfuscated payloads (zero-width Unicode, base64, homoglyphs, hex), C2-pattern URLs, credential leakage. ratine diff compares snapshots for belief drift.
Sources (45 cited facts, 1 third-party)
Each fact links to the page it came from; the badge says who published it (how to read sources).
- What it is Memory mutations as distinct span types vendor
- What it does & what's distinct Memory reads, vector DB retrievals, state changes are distinct span types in traces. RAG… vendor
- Claims / benefits Free 5k traces/month Developer; Plus $39/mo; Enterprise custom. No automated drift / poi… vendor
- Modalities text vendor
- Created 2023 (LangSmith beta summer 2023; GA Feb 2024 with $25M Series A) vendor
- Latest release SDK v0.14.11 (2026-10-16) — platform itself proprietary registry
- Funding LangChain total ~$160M ($10M seed Benchmark 2023; $25M Series A Sequoia Feb 2024 at $200… third-party
- Pricing Developer: free (5K traces/mo); Plus: $39/seat/mo (10K traces); Enterprise: custom (SSO/… vendor
- Compliance SOC 2 Type II (Enterprise tier); SAML SSO vendor
- Data handling cloud SaaS; no self-host option publicly announced; Enterprise: dedicated tenant vendor
- Deployment SaaS cloud (US); Enterprise: dedicated tenant vendor
- HQ San Francisco CA vendor
- Founders / pedigree LangChain Inc. (Harrison Chase, co-founder; ex-Robust Intelligence; Sequoia-backed) vendor
- Memory volume / scale internal — undisclosed (SaaS observability) vendor
- Performance no public benchmark scores found — vendor does not publish quantitative perf metrics vendor
- API surface REST, SDK: Python, JS/TS vendor
- Backend storage custom (LangChain-managed) vendor
- Multi-tenancy namespace (workspace/project) vendor
- Encryption at-rest + in-transit vendor
- SSO / RBAC SSO + RBAC vendor
- Consistency not specified — vendor docs do not address this dimension for memory vendor
- Versioning immutable append-log vendor
- Tombstoning append-only no delete vendor
- Schema evolution schema with migration vendor
- Namespace primitives project / org / session — typical SaaS multi-tenant vendor
- Forgetting policy none (permanent) vendor
- MCP support via LangChain MCP adapters vendor
- OTel first-class — OTel ingestion + export vendor
- Webhooks / events webhooks supported (alerts) vendor
- Import / export JSON via REST (JSON-over-REST; CSV/Parquet export for analytical use) vendor
- Validated verticals agent developers + AI platform teams (horizontal) vendor
- Time to running <10min (hosted SaaS) to <1hr (self-host) vendor
- Anti-fit not for use cases that don't run agent workloads in production vendor
- Optimised for memory operation tracing + drift / poisoning detection vendor
- Adjacent infrastructure BYO agent stack; this layer observes it vendor
- Pros Best integration with the LangChain / LangGraph stack — debug memory + chain + agent in … vendor
- Cons LangChain-shaped — works less well outside that ecosystem; closed SaaS. vendor
- Project & sources langchain.com/langsmith vendor
- architecture-deployment-locus cloud vendor
- licensing-bucket commercial vendor
- positioning-platform-vs-product platform vendor
- taxonomy-three-layer-rollup agent-infra repo
- compliance-certifications gdpr,hipaa,iso27001,iso42001,soc2-type2 vendor
- sdk-languages python,rest,typescript repo
- protocol-support mcp-server,opentelemetry vendor
What changed
Changes to this record's lifecycle, licence, release, pricing and hosting facts, from the catalog's git history. Subscribe (Atom)
- 2026-10-23
- Funding / ownership “LangChain total ~$35M+ ($3M seed Benchmark 2023; $25M Series A Sequoia Feb 2024; $125M Oct 2025 unicorn round at $1…” → “LangChain total ~$160M ($10M seed Benchmark 2023; $25M Series A Sequoia Feb 2024 at $200M post-money; $125M Oct 2025 round at $1.25B valuation)” source
- 2026-10-22
- Latest release “not applicable — not OSS” → “SDK v0.14.11 (2026-10-16) — platform itself proprietary” source
Related systems
References (29)
- Anthropic Claude (foundation models) integrates with — LangSmith docs have a tracing integration page for Anthropic Claude (foundation models). (verified 2026-10-29)
- AutoGen / AG2 integrates with — LangSmith docs have a tracing integration page for AutoGen / AG2. (verified 2026-10-29)
- Claude Agent SDK integrates with — LangSmith docs have a tracing integration page for Claude Agent SDK. (verified 2026-10-29)
- Claude Code (Anthropic) integrates with — LangSmith docs have a tracing integration page for Claude Code (Anthropic). (verified 2026-10-29)
- CrewAI integrates with — LangSmith docs have a tracing integration page for CrewAI. (verified 2026-10-29)
- Cursor (IDE) integrates with — LangSmith docs have a tracing integration page for Cursor (IDE). (verified 2026-10-29)
- DeepSeek R1 / V3 family integrates with — LangSmith docs have a tracing integration page for DeepSeek R1 / V3 family. (verified 2026-10-29)
- Google Agent Development Kit (ADK) integrates with — LangSmith docs have a tracing integration page for Google Agent Development Kit (ADK). (verified 2026-10-29)
- Google Gemini 3 family integrates with — LangSmith docs have a tracing integration page for Google Gemini 3 family. (verified 2026-10-29)
- LangChain (framework) integrates with · depends on at runtime — Best integration with the LangChain / LangGraph stack — debug memory + chain + agent in one trace
- LangGraph (orchestration) integrates with — LangSmith docs have a tracing integration page for LangGraph (orchestration). (verified 2026-10-29)
- LangGraph Persistence integrates with — de-facto trace tool for that ecosystem
- LiteLLM integrates with — LangSmith docs have a tracing integration page for LiteLLM. (verified 2026-10-29)
- LiveKit Agents integrates with — LangSmith docs have a tracing integration page for LiveKit Agents. (verified 2026-10-29)
- Mastra integrates with — LangSmith docs have a tracing integration page for Mastra. (verified 2026-10-29)
- Microsoft Agent Framework integrates with — LangSmith docs have a tracing integration page for Microsoft Agent Framework. (verified 2026-10-29)
- Microsoft Semantic Kernel integrates with — LangSmith docs have a tracing integration page for Microsoft Semantic Kernel. (verified 2026-10-29)
- Mistral Large 2 / Mixtral family integrates with — LangSmith docs have a tracing integration page for Mistral Large 2 / Mixtral family. (verified 2026-10-29)
- n8n (AI agent flows) integrates with — LangSmith docs have a tracing integration page for n8n (AI agent flows). (verified 2026-10-29)
- OpenAI Agents SDK integrates with — LangSmith docs have a tracing integration page for OpenAI Agents SDK. (verified 2026-10-29)
- OpenAI Codex CLI integrates with — LangSmith docs have a tracing integration page for OpenAI Codex CLI. (verified 2026-10-29)
- OpenAI GPT family (GPT-5 / GPT-4o / o3 / o4) integrates with — LangSmith docs have a tracing integration page for OpenAI GPT family (GPT-5 / GPT-4o / o3 / o4). (verified 2026-10-29)
- OpenAI Realtime API integrates with — LangSmith docs have a tracing integration page for OpenAI Realtime API. (verified 2026-10-29)
- Opencode (SST) integrates with — LangSmith docs have a tracing integration page for Opencode (SST). (verified 2026-10-29)
- Pipecat (Daily) integrates with — LangSmith docs have a tracing integration page for Pipecat (Daily). (verified 2026-10-29)
- Pydantic-AI integrates with — LangSmith docs have a tracing integration page for Pydantic-AI. (verified 2026-10-29)
- Strands Agents (AWS) integrates with — LangSmith docs have a tracing integration page for Strands Agents (AWS). (verified 2026-10-29)
- Temporal integrates with — LangSmith docs have a tracing integration page for Temporal. (verified 2026-10-29)
- Vercel AI SDK integrates with — LangSmith docs have a tracing integration page for Vercel AI SDK. (verified 2026-10-29)
Referenced by (16)
- agentgateway integrates with — agentgateway integrations docs have a LangSmith observability page. (verified 2026-10-29)
- Braintrust integrates with — Braintrust docs have a LangSmith integration page. (verified 2026-10-29)
- Dify integrates with — Dify monitoring integration: "Integrate with LangSmith" (tracing). (verified 2026-10-29)
- Guardrails AI integrates with — Guardrails AI docs have a LangSmith integration section on its LangChain page. (verified 2026-10-29)
- LangChain (framework) integrates with — LangChain docs have a LangSmith sandbox integration page. (verified 2026-10-29)
- Langflow integrates with — Langflow integration page: LangSmith tracing. (verified 2026-10-29)
- LangGraph (orchestration) integrates with — LangGraph observability docs show tracing LangGraph agents to LangSmith. (verified 2026-10-29)
- LiteLLM integrates with — LiteLLM docs have a LangSmith logging/observability integration page. (verified 2026-10-29)
- Mastra integrates with — Mastra repo ships the @mastra/langsmith observability exporter. (verified 2026-10-29)
- OpenAI Agents SDK integrates with — OpenAI Agents SDK tracing docs list LangSmith under external tracing processors. (verified 2026-10-29)
- OpenLLMetry (Traceloop) integrates with — OpenLLMetry docs have a page on exporting traces to LangSmith. (verified 2026-10-29)
- OpenRouter integrates with — OpenRouter Broadcast docs have a page for sending request traces to LangSmith. (verified 2026-10-29)
- Portkey AI integrates with — Portkey docs have a Langsmith tracing provider integration page. (verified 2026-10-29)
- Temporal integrates with — Temporal integrations catalog lists LangSmith tracing integration (Python, TypeScript). (verified 2026-10-29)
- TrueFoundry AI Gateway integrates with — TrueFoundry AI Gateway ecosystem lists a LangSmith integration page. (verified 2026-10-29)
- Vercel AI SDK integrates with — AI SDK docs have a LangSmith observability integration page. (verified 2026-10-29)