ElevenLabs Conversational AI (now ElevenAgents)
https://elevenlabs.io/conversational-ai
ElevenLabs launched Conversational AI Nov-2024 — STT + LLM + their own market-leading TTS in one pipeline. Combines vendor's voice cloning + multilingual TTS strengths with hosted call orchestration. ElevenLabs raised $180M Series C Jan-2025 at $3.3B val. As of 2026-10 ElevenLabs markets the platform as ElevenAgents.
Renamed · Verified 2026-10-29 · fresh as of 2026-10-29 · 63 cited facts, 2 with a third-party source · 2 recorded changes · Suggest a correction
At a glance
- Tier
- T1
- Section
- Voice agent platforms
- Created
- 2024-11 (launch) vendor fix
- Latest release
- not applicable — not OSS fix
- License
- not applicable — not OSS fix
- GitHub
- github.com/elevenlabs (SDKs only) repo fix
- Pricing
- Per-minute usage (Conv AI tier); free + Pro + Enterprise vendor fix
- Funding
- $180M Series C Jan-2025 (a16z + ICONIQ; $3.3B val) third-party fix
- Freshness
- 2026-10-29 fix
- Layer
- agent-infra repo fix
- Licensing
- commercial vendor fix
- SDK languages
- python, rest, typescript vendor fix
- Protocols
- mcp-client, mcp-server vendor fix
When to use
Optimised for: Natural-sounding multilingual voice agents leveraging ElevenLabs TTS
Anti-fit: TTS-led — strongest at voice naturalness, less specialised for high-volume telephony routing
Pros & cons
Pros
Best-in-class TTS; $3.3B val parent; SOC 2 + HIPAA; multilingual 30+ languages.
Cons
Newer entrant in agent platform (Nov 2024 launch); strongest at TTS, less mature at full orchestration.
Claims & capabilities
Launched Nov-2024; ElevenLabs voice models are TTS SOTA; Series C Jan-2025 $3.3B val
Technical surface
- API surface
- REST + WebSocket APIs + SDKs (Python, JS, Swift, Android)
- Backend storage
- Conversation state in ElevenLabs cloud
- Deployment
- Cloud-managed
- Embedding model
- not applicable — not a memory product
- Multi-tenancy
- Multi-tenant cloud
- MCP
- yes — hosted ElevenLabs MCP server (recommended); local elevenlabs-mcp server deprecated/archived 2026-08-20
- A2A
- searched not found
- OpenTelemetry
- searched not found
Compare ElevenLabs Conversational AI (now ElevenAgents) with…
Alternatives to ElevenLabs Conversational AI (now ElevenAgents) → live options ranked by shared design, licence, hosting and MCP support
Similar systems
Other voice agent platforms in the catalog, ranked by inbound references.
- Cartesia Sonic T1
Cartesia's Sonic TTS — state-space-model-based voice generation, lowest published TTS latency (~40ms). Cartesia raised $64M Series A Q1 2025 (Index + Lightspeed); founded by Mamba authors. Agent platform layer ('Cartesia Line') wraps Sonic with telephony + LLM.
- LiveKit Agents T1
LiveKit Agents — agent framework built on LiveKit's open-source WebRTC media server. LiveKit raised $45M Series B Sep-2024 ($300M val). Powers OpenAI Realtime API's WebRTC transport (LiveKit is the substrate OpenAI chose). Agents framework formally launched 2024.
- OpenAI Realtime API T1
OpenAI's Realtime API for native speech-to-speech multimodal interaction with GPT-4o — launched Oct 2024 (DevDay). Skips the STT → LLM → TTS pipeline by passing speech directly to GPT-4o. The platform substrate that Vapi/Retell/Bland integrate as one of their LLM choices.
- Pipecat (Daily) T1
Open-source Python framework for real-time voice + multimodal AI agents, maintained by Daily.co. Pipeline-style architecture (STT → context → LLM → TTS) wired over WebRTC. The OSS substrate that many of the voice platforms build on or compose with.
- Hume EVI T1
Hume's Empathic Voice Interface (EVI) — voice agent platform with vocal-affect understanding, using Hume's proprietary speech-prosody models. Hume will shut down the EVI and TTS APIs on 2026-11-13 (announced in its docs). Hume raised $50M Series B Mar-2024 (EQT).
- Speechmatics Flow T2
Speechmatics (UK; STT leader) launched Flow Q4 2024 — conversational voice-agent platform composed on Speechmatics STT + caller LLM. Speechmatics raised $62M Series B (2022); enterprise + media customers. UK / EU data-residency lead. As of 2026-10 the Flow pages and docs redirect to Agent STT, a speech-to-text API for voice agents (Linden model, from $0.30/hour) used via LiveKit, Pipecat or the API; Flow itself is no longer listed.
Sources (62 cited facts, 2 third-party)
Each fact links to the page it came from; the badge says who published it (how to read sources).
- What it is Voice-agent platform from a TTS-first vendor (ElevenLabs) vendor
- What it does & what's distinct ElevenLabs launched Conversational AI Nov-2024 — STT + LLM + their own market-leading TT… vendor
- Claims / benefits Launched Nov-2024; ElevenLabs voice models are TTS SOTA; Series C Jan-2025 $3.3B val vendor
- Modalities voice (WebRTC + PSTN via Twilio) + text + 30+ languages vendor
- Created 2024-11 (launch) vendor
- GitHub github.com/elevenlabs (SDKs only) repo
- Mindshare ElevenLabs is the dominant TTS brand 2024-2025; Conversational AI launch was widely cove… vendor
- Funding $180M Series C Jan-2025 (a16z + ICONIQ; $3.3B val) third-party
- Customers / scale Major media + enterprise; >$80M ARR per reports (parent) vendor
- Pricing Per-minute usage (Conv AI tier); free + Pro + Enterprise vendor
- Compliance SOC 2 Type II; GDPR; HIPAA vendor
- Data handling EU + US regions; opt-out from training vendor
- Deployment Cloud-managed vendor
- HQ UK (London) / US vendor
- Founders / pedigree Mati Staniszewski + Piotr Dąbkowski vendor
- Performance Sub-1s turn latency; SOTA TTS naturalness vendor
- API surface REST + WebSocket APIs + SDKs (Python, JS, Swift, Android) vendor
- Latency p50/p99 <1s turn-to-turn vendor claim vendor
- Backend storage Conversation state in ElevenLabs cloud vendor
- Multi-tenancy Multi-tenant cloud vendor
- Encryption TLS + AES-256 vendor
- SSO / RBAC SSO on Enterprise vendor
- Versioning Agents versioned in dashboard vendor
- Tombstoning User-delete vendor
- Namespace primitives per-workspace / per-agent vendor
- Forgetting policy Configurable retention vendor
- MCP support yes — hosted ElevenLabs MCP server (recommended); local elevenlabs-mcp server deprecated… repo
- Webhooks / events Webhooks supported vendor
- Import / export Agent config exportable vendor
- Validated verticals horizontal — media, gaming, customer support, IVR vendor
- Time to running <30min (sign-up + agent build) vendor
- Anti-fit TTS-led — strongest at voice naturalness, less specialised for high-volume telephony rou… vendor
- Optimised for Natural-sounding multilingual voice agents leveraging ElevenLabs TTS vendor
- Adjacent infrastructure Twilio SIP; ElevenLabs STT/TTS; multiple LLM providers vendor
- Pros Best-in-class TTS; $3.3B val parent; SOC 2 + HIPAA; multilingual 30+ languages. vendor
- Cons Newer entrant in agent platform (Nov 2024 launch); strongest at TTS, less mature at full… vendor
- Project & sources elevenlabs.io/conversational-ai; elevenlabs.io/docs/conversational-ai vendor
- obs-langfuse yes third-party
- obs-custom First-party call-replay and metrics dashboards vendor
- cost-token-budget no vendor
- cost-prompt-caching no vendor
- cost-semantic-caching no vendor
- cost-batching no vendor
- cost-model-routing yes vendor
- cost-streaming-only yes vendor
- cost-observability-cost-attribution no vendor
- eval-langsmith-evals no vendor
- eval-braintrust no vendor
- eval-weights-and-biases-agent no vendor
- eval-helicone-evals no vendor
- eval-custom-test-harness no vendor
- eval-human-loop no vendor
- eval-production-traffic-replay no vendor
- cost-pricing-model subscription vendor
- cost-last-verified 2026-06-29 vendor
- architecture-deployment-locus cloud vendor
- licensing-bucket commercial vendor
- positioning-platform-vs-product platform vendor
- taxonomy-three-layer-rollup agent-infra repo
- compliance-certifications ccpa,csa-star,fedramp,gdpr,hipaa,iso27001,iso27017,iso27018,iso27701,iso42001,pci-dss,so… vendor
- sdk-languages python,rest,typescript vendor
- protocol-support mcp-client,mcp-server vendor
What changed
Changes to this record's lifecycle, licence, release, pricing and hosting facts, from the catalog's git history. Subscribe (Atom)
Related systems
Referenced by (8)
- Braintrust integrates with — Braintrust docs have a ElevenLabs Conversational AI integration page. (verified 2026-10-29)
- Langfuse integrates with — Langfuse's integrations directory has a ElevenLabs Conversational AI integration page. (verified 2026-10-29)
- LiveKit Agents integrates with — LiveKit Agents docs have a ElevenLabs Conversational AI model plugin page. (verified 2026-10-29)
- LlamaIndex (framework) integrates with — LlamaIndex has an official voice agent integration package llama-index-voice-agents-elevenlabs in its repo. (verified 2026-10-29)
- Mem0 integrates with — Mem0 docs have an ElevenLabs integration page (Create voice-based conversational AI agents with ElevenLabs and Mem0 for context-aware voice interactions). (verified 2026-10-29)
- Pipecat (Daily) integrates with — Pipecat docs have a ElevenLabs Conversational AI service page. (verified 2026-10-29)
- Pydantic-AI integrates with — Pydantic AI realtime docs connect agents to hosted ElevenLabs Agents (ElevenAgents) via ElevenLabsAgentsRealtimeModel. (verified 2026-10-29)
- Vapi integrates with — Vapi docs list ElevenLabs Conversational AI as a provider/integration. (verified 2026-10-29)