{"family":"embodied","name":"Voice, Computer-use & Embodied Agents","count":53,"license":"CC-BY-4.0","systems":[{"id":"1x-technologies--1x-tech","name":"1X Technologies","url":"https://www.1x.tech/","section":"Robotics foundation models & agent stacks","tier":2,"status":"active","last_verified_at":"2026-10-26","type":"Humanoid robot maker (Neo / Eve) — OpenAI portfolio","license":"","latest_release":"NEO home humanoid (orders opened 2025-10-28; US deliveries slated 2026); NEO hands platform (2026-07-09)","deployment":"Direct customer (industrial Eve + consumer Neo)","pricing":"NEO: $20,000 early-access purchase (3-yr warranty) or $499/month subscription; $200 refundable deposit","mcp_support":"","a2a_support":"","backend_storage":"Internal 1X cloud","github":"","storage":"","retrieval":"","persistence":"","update":"","unit":"","governance":"","conflict":"","description":"Norway / US humanoid robot company — Eve (wheeled bimanual) + Neo (legged humanoid, consumer-targeted, late 2025 / 2026 launch). Raised $100M Series B (Jan-2024, EQT + OpenAI Startup Fund); $40M Series A (Mar-2023, OpenAI lead). Distinguishing feature: consumer-home positioning rather than industrial.","cited_cells":33,"third_party_cells":1,"page":"https://mrpeppersdev.github.io/agent-infrastructure-landscape/systems/1x-technologies--1x-tech"},{"id":"agility-robotics--agilityrobotics-com","name":"Agility Robotics","url":"https://agilityrobotics.com/","section":"Robotics foundation models & agent stacks","tier":2,"status":"active","last_verified_at":"2026-10-26","type":"Bipedal warehouse robot maker (Digit) — first US humanoid commercial deployment","license":"","latest_release":"Digit 5 (unveiled 2026-09-15; early access H1 2027, GA by end-2027)","deployment":"Warehouse deployment; RaaS model","pricing":"Robot-as-a-Service (RaaS) — vendor reports per-hour rates","mcp_support":"","a2a_support":"","backend_storage":"Internal cloud","github":"","storage":"","retrieval":"","persistence":"","update":"","unit":"","governance":"","conflict":"","description":"Oregon-based humanoid maker; Digit is in production at GXO Logistics warehouses since Sep-2024 — claimed first humanoid in commercial service in the US. Spinout of Oregon State University. $400M+ raised (Amazon Industrial Innovation Fund participant).","cited_cells":35,"third_party_cells":0,"page":"https://mrpeppersdev.github.io/agent-infrastructure-landscape/systems/agility-robotics--agilityrobotics-com"},{"id":"anthropic-computer-use--docs-anthropic-com","name":"Anthropic Computer Use","url":"https://docs.anthropic.com/en/docs/agents-and-tools/computer-use","section":"Computer-use & desktop agents","tier":1,"status":"active","last_verified_at":"2026-10-31","type":"Claude desktop-control capability (Anthropic API)","license":"proprietary (Claude API feature)","latest_release":"computer_toolset_20260801 (2026-08) — current tool version, no beta header required","deployment":"Managed-only — Claude API tool (also Bedrock, Vertex, Foundry); actions execute in a caller-provided desktop environment","pricing":"Standard Claude API token pricing; ~4.5k input-token toolset overhead plus screenshots billed as image input; no per-action fee","mcp_support":"no — computer use is a client-executed API tool, not an MCP server or client","a2a_support":"searched not found","backend_storage":"stateless API","github":"","storage":"","retrieval":"","persistence":"","update":"","unit":"","governance":"","conflict":"","description":"Anthropic's API-surface capability that lets Claude control a virtual desktop — see screenshots, type, click. Launched 2024-10 as a public beta. Not a finished IDE itself; it's the substrate that other harnesses (and Anthropic's own Claude apps) use to operate a computer.","cited_cells":62,"third_party_cells":11,"page":"https://mrpeppersdev.github.io/agent-infrastructure-landscape/systems/anthropic-computer-use--docs-anthropic-com"},{"id":"apptronik--apptronik-com","name":"Apptronik","url":"https://apptronik.com/","section":"Robotics foundation models & agent stacks","tier":2,"status":"active","last_verified_at":"2026-10-27","type":"Humanoid robot maker (Apollo) — Google DeepMind partner","license":"","latest_release":"Apollo (humanoid)","deployment":"Direct customer (manufacturing + logistics)","pricing":"","mcp_support":"","a2a_support":"","backend_storage":"Internal Apptronik cloud","github":"","storage":"","retrieval":"","persistence":"","update":"","unit":"","governance":"","conflict":"","description":"Apollo humanoid maker, spun out of University of Texas Human Centered Robotics Lab. Raised $350M Series A (Feb-2025; B Capital + Capital Factory); Mercedes-Benz manufacturing partner (Mar 2024). Partnered with Google DeepMind on Gemini Robotics (Mar 2025) — Apollo is the headline reference platform for Gemini Robotics.","cited_cells":32,"third_party_cells":2,"page":"https://mrpeppersdev.github.io/agent-infrastructure-landscape/systems/apptronik--apptronik-com"},{"id":"bee--bee-computer","name":"Bee","url":"https://bee.computer","section":"Voice-first / wearable AI memory","tier":1,"status":"acquired","last_verified_at":"2026-10-29","type":"Audio pendant — never stores raw audio","license":"","latest_release":"","deployment":"Managed-only","pricing":"Bee Frontier bracelet $74.99 (sold via Amazon, launched 2026-10-15); Bee Pro subscription $11.99/mo (free tier keeps 14 days of memory); Bee Eclipse ($100) coming soon","mcp_support":"searched not found","a2a_support":"searched not found","backend_storage":"custom","github":"","storage":"vector","retrieval":"similarity","persistence":"lifelong","update":"append-only","unit":"episode","governance":"user-controllable","conflict":"append","description":"Acquired by Amazon (Jul 2025); bee.computer is now © Amazon and sells the Bee Frontier wearable ($74.99), with a Bee Eclipse device marked coming soon. Small wearable (pendant / clip / bracelet). Continuous capture; converts speech to text immediately; never stores raw audio . Daily summaries, personal fact sheet, to-do suggestions. Cloud processing on derived text only.","cited_cells":37,"third_party_cells":7,"page":"https://mrpeppersdev.github.io/agent-infrastructure-landscape/systems/bee--bee-computer"},{"id":"bland-ai--bland-ai","name":"Bland AI","url":"https://www.bland.ai/","section":"Voice agent platforms","tier":1,"status":"active","last_verified_at":"2026-10-26","type":"Developer platform for AI phone agents (vertically integrated)","license":"","latest_release":"","deployment":"Both (self-hosted + managed cloud) — managed cloud by default; on-prem/VPC deployment on Enterprise only","pricing":"Start: $0 platform fee + $0.14/connected min; Build: $299/mo + $0.12/min; Enterprise custom","mcp_support":"yes — remote MCP server at api.bland.ai/v1/mcp for MCP clients (Claude, Claude Code, ChatGPT, VS Code, Windsurf, Gemini CLI)","a2a_support":"searched not found","backend_storage":"Call + pathway state in Bland-managed DB","github":"","storage":"","retrieval":"","persistence":"","update":"","unit":"","governance":"","conflict":"","description":"Voice-AI platform with custom STT + LLM + TTS stack ('the whole pipeline'). Raised $40M Series A Apr-2024 (Lightspeed + Anthology). Distinguished by 'pathway' graphs (deterministic call flows) and aggressive outbound-calling positioning.","cited_cells":46,"third_party_cells":1,"page":"https://mrpeppersdev.github.io/agent-infrastructure-landscape/systems/bland-ai--bland-ai"},{"id":"browser-use--browser-use-com","name":"Browser Use","url":"https://browser-use.com/","section":"Computer-use & desktop agents","tier":1,"status":"active","last_verified_at":"2026-10-31","type":"OSS browser-agent library + Cloud (browser-use)","license":"MIT","latest_release":"v0.13.11 (2026; release date not confirmed)","deployment":"Both (self-hosted + managed cloud) — OSS Python library + Browser Use Cloud; on-prem via sales","pricing":"OSS library free; Cloud pay-as-you-go: $1 free credit, $5 min top-up, browsers $0.02/hr, agents = model price +20%; on-prem via sales","mcp_support":"yes — first-party hosted MCP server (api.browser-use.com/v3/mcp) plus local stdio browser-harness-mcp","a2a_support":"searched not found","backend_storage":"Local Playwright state; Cloud uses managed Postgres","github":"browser-use/browser-use — ~119k stars, last commit 2026-09+ (release 0.13.10 on 2026-09-04)","storage":"","retrieval":"","persistence":"","update":"","unit":"","governance":"","conflict":"","description":"Python library that turns any LLM into a browser agent — extracts DOM into a structured representation the LLM can act on (rather than pure screenshot). Browser Use Inc. raised $17M seed Q1 2025 (Felicis); cloud product at cloud.browser-use.com. Project is one of the most-starred browser-agent OSS repos.","cited_cells":67,"third_party_cells":5,"page":"https://mrpeppersdev.github.io/agent-infrastructure-landscape/systems/browser-use--browser-use-com"},{"id":"bytebot--bytebot-ai","name":"Bytebot","url":"https://bytebot.ai/","section":"Computer-use & desktop agents","tier":3,"status":"archived","last_verified_at":"2026-10-29","type":"OSS desktop-control agent runtime (containerised Linux desktop)","license":"Apache-2.0","latest_release":"none — no GitHub releases published; repo archived 2026-03-07","deployment":"Self-hosted only — Docker (Linux desktop container); repo archived","pricing":"Free (Apache-2.0 OSS; repo archived, no paid tier listed)","mcp_support":"searched not found","a2a_support":"searched not found","backend_storage":"Container ephemeral disk; user provides durable storage","github":"bytebot-ai/bytebot — ~11.1k stars, archived 2026-03-07","storage":"","retrieval":"","persistence":"","update":"","unit":"","governance":"","conflict":"","description":"Open-source desktop-agent runtime that runs an LLM-controlled Linux desktop inside Docker — uses xdotool / X11 capture for control. Pitched as the 'self-hosted Operator' alternative; agent sees a real desktop screen, not just a browser.","cited_cells":39,"third_party_cells":2,"page":"https://mrpeppersdev.github.io/agent-infrastructure-landscape/systems/bytebot--bytebot-ai"},{"id":"callrail-conversation-intelligence--callrail-com","name":"CallRail Conversation Intelligence","url":"https://www.callrail.com/conversation-intelligence","section":"Voice agent platforms","tier":2,"status":"active","last_verified_at":"2026-10-26","type":"Conversation intelligence / call analytics platform","license":"","latest_release":"","deployment":"Managed-only — CallRail-hosted SaaS","pricing":"No free tier; plans from $50/mo (Lead Tracking); Premium Conversation Intelligence included in Lead Conversion ($150/mo) and Lead Conversion Complete ($195/mo)","mcp_support":"no — not mentioned on product page","a2a_support":"searched not found","backend_storage":"CallRail-managed cloud (call recording + AI metadata)","github":"","storage":"","retrieval":"","persistence":"","update":"","unit":"","governance":"","conflict":"","description":"CallRail's AI-driven conversation intelligence layer atop their call-tracking product. Marketing-vertical voice analytics — auto-tagging, sentiment, lead scoring. CallRail is profitable / private (Sageview-backed); not a voice-agent runtime but the BI / analytics adjacent layer.","cited_cells":42,"third_party_cells":1,"page":"https://mrpeppersdev.github.io/agent-infrastructure-landscape/systems/callrail-conversation-intelligence--callrail-com"},{"id":"cartesia-sonic--cartesia-ai","name":"Cartesia Sonic","url":"https://cartesia.ai/sonic","section":"Voice agent platforms","tier":1,"status":"active","last_verified_at":"2026-10-26","type":"Real-time TTS + voice-agent platform (Cartesia)","license":"","latest_release":"Sonic-3.6 (current model; release date not stated)","deployment":"Both (self-hosted + managed cloud) — managed API; on-prem (incl. air-gapped), customer VPC and OEM under enterprise contract","pricing":"Free (20K credits/mo); Pro $5/mo; Startup $49/mo; Scale $299/mo; Enterprise custom; managed voice agents $0.06/min","mcp_support":"yes — official Cartesia MCP server (cartesia-ai/cartesia-mcp)","a2a_support":"searched not found","backend_storage":"Stateless API; caller manages state","github":"github.com/cartesia-ai (SDKs)","storage":"","retrieval":"","persistence":"","update":"","unit":"","governance":"","conflict":"","description":"Cartesia's Sonic TTS — state-space-model-based voice generation, lowest published TTS latency (~40ms). Cartesia raised $64M Series A Q1 2025 (Index + Lightspeed); founded by Mamba authors. Agent platform layer ('Cartesia Line') wraps Sonic with telephony + LLM.","cited_cells":46,"third_party_cells":2,"page":"https://mrpeppersdev.github.io/agent-infrastructure-landscape/systems/cartesia-sonic--cartesia-ai"},{"id":"claude-for-chrome--anthropic-com","name":"Claude for Chrome","url":"https://claude.com/resources/articles/claude-for-chrome","section":"Computer-use & desktop agents","tier":1,"status":"active","last_verified_at":"2026-10-29","type":"Consumer browser-agent extension (Chrome) — Anthropic","license":"","latest_release":"","deployment":"Managed-only — Chrome extension in the user's browser; model runs in Anthropic cloud","pricing":"Not on Free; included in Pro ($20/mo, $17 annual), Max (from $100/mo), Team and Enterprise","mcp_support":"Claude supports MCP servers (caller-side)","a2a_support":"searched not found","backend_storage":"Anthropic-managed session state; local extension storage","github":"","storage":"","retrieval":"","persistence":"","update":"","unit":"","governance":"","conflict":"","description":"Anthropic's Chrome extension (Claude in Chrome) letting Claude act inside the user's own browser. Research preview Aug 2025; beta for all Max users Nov 2025; on all paid plans since Dec 2025. Distinct from the Computer Use API.","cited_cells":58,"third_party_cells":0,"page":"https://mrpeppersdev.github.io/agent-infrastructure-landscape/systems/claude-for-chrome--anthropic-com"},{"id":"collaborative-robotics--co-bot","name":"Collaborative Robotics","url":"https://www.co.bot/","section":"Robotics foundation models & agent stacks","tier":3,"status":"active","last_verified_at":"2026-10-27","type":"Collaborative robot maker (Brad Porter / ex-Amazon Robotics)","license":"","latest_release":"","deployment":"Direct customer pilot","pricing":"","mcp_support":"","a2a_support":"","backend_storage":"Internal cloud","github":"","storage":"","retrieval":"","persistence":"","update":"","unit":"","governance":"","conflict":"","description":"Founded 2022 by Brad Porter (ex-Amazon Robotics VP + Scale AI CTO). Stealthier than the humanoid pack; raised $100M Series B Apr-2024 (General Catalyst). Targets warehouse + healthcare collaborative robots.","cited_cells":28,"third_party_cells":1,"page":"https://mrpeppersdev.github.io/agent-infrastructure-landscape/systems/collaborative-robotics--co-bot"},{"id":"covariant--covariant-ai","name":"Covariant","url":"https://covariant.ai/","section":"Robotics foundation models & agent stacks","tier":2,"status":"active","last_verified_at":"2026-10-29","type":"Robotics foundation-model company (warehouse pick-and-place) — acqui-hired by Amazon Aug 2024","license":"","latest_release":"RFM-1 (Mar 2024)","deployment":"On-prem (warehouse) + cloud hybrid","pricing":"Enterprise; per-robot / per-pick fees","mcp_support":"","a2a_support":"","backend_storage":"Customer trajectory data on Covariant + customer infra","github":"","storage":"","retrieval":"","persistence":"","update":"","unit":"","governance":"","conflict":"","description":"Pieter Abbeel / Peter Chen-founded robotics FM company — built RFM-1 (Robotics Foundation Model, Mar 2024) for warehouse pick-and-place. In Aug 2024 Amazon took a non-exclusive license to its robotic foundation models and hired founders Abbeel, Chen and Rocky Duan plus research staff; Covariant was not acquired and continued serving customers. As of 2026-10-29 covariant.ai is a placeholder page (logo, video and a 2026 copyright line only; no product or contact pages).","cited_cells":39,"third_party_cells":2,"page":"https://mrpeppersdev.github.io/agent-infrastructure-landscape/systems/covariant--covariant-ai"},{"id":"elevenlabs-conversational-ai--elevenlabs-io","name":"ElevenLabs Conversational AI (now ElevenAgents)","url":"https://elevenlabs.io/conversational-ai","section":"Voice agent platforms","tier":1,"status":"renamed","last_verified_at":"2026-10-29","type":"Voice-agent platform from a TTS-first vendor (ElevenLabs)","license":"","latest_release":"","deployment":"Cloud-managed","pricing":"Per-minute usage (Conv AI tier); free + Pro + Enterprise","mcp_support":"yes — hosted ElevenLabs MCP server (recommended); local elevenlabs-mcp server deprecated/archived 2026-08-20","a2a_support":"searched not found","backend_storage":"Conversation state in ElevenLabs cloud","github":"github.com/elevenlabs (SDKs only)","storage":"","retrieval":"","persistence":"","update":"","unit":"","governance":"","conflict":"","description":"ElevenLabs launched Conversational AI Nov-2024 — STT + LLM + their own market-leading TTS in one pipeline. Combines vendor's voice cloning + multilingual TTS strengths with hosted call orchestration. ElevenLabs raised $180M Series C Jan-2025 at $3.3B val. As of 2026-10 ElevenLabs markets the platform as ElevenAgents.","cited_cells":62,"third_party_cells":2,"page":"https://mrpeppersdev.github.io/agent-infrastructure-landscape/systems/elevenlabs-conversational-ai--elevenlabs-io"},{"id":"era-computer--techcrunch-com","name":"Era Computer","url":"https://era.world/","section":"Voice-first / wearable AI memory","tier":5,"status":"active","last_verified_at":"2026-10-29","type":"User-sovereign pluggable memory layer for wearable OS","license":"","latest_release":"","deployment":"","pricing":"","mcp_support":"","a2a_support":"","backend_storage":"","github":"","storage":"proprietary","retrieval":"agentic","persistence":"long-term","update":"agent-controlled","unit":"file","governance":"user-controllable","conflict":"none","description":"Software platform / OS layer for AI wearables (glasses, rings, pendants, speakers) that abstracts hardware from AI orchestration. Memory and model providers are pluggable and user-controlled rather than cloud-locked; supports 130+ LLMs from 14+ providers. Founded 2025 by ex-Humane team.","cited_cells":19,"third_party_cells":17,"page":"https://mrpeppersdev.github.io/agent-infrastructure-landscape/systems/era-computer--techcrunch-com"},{"id":"figure-ai--figure-ai","name":"Figure AI","url":"https://www.figure.ai/","section":"Robotics foundation models & agent stacks","tier":1,"status":"active","last_verified_at":"2026-10-29","type":"Humanoid robot maker (Figure 01 / Figure 02 / Helix VLA model)","license":"","latest_release":"Helix 2.5 (2026-09-17)","deployment":"Direct customer deployment (humanoid robot)","pricing":"","mcp_support":"","a2a_support":"","backend_storage":"Internal Figure cloud","github":"","storage":"","retrieval":"","persistence":"","update":"","unit":"","governance":"","conflict":"","description":"Figure AI — humanoid robot maker founded 2022 by Brett Adcock (ex-Archer Aviation). Figure 02 (Aug 2024) + Helix VLA model (Feb 2025) for full-body / hand control. Raised $675M Series B Feb-2024 (Microsoft / OpenAI / Bezos / Intel; $2.6B val); reported new round at $39.5B val Q2 2025. Partnered with BMW for manufacturing pilots. Figure 03 (introduced 2025-10-09) is now marketed as a general-purpose home-help humanoid running Helix; Figure 02 was decommissioned (2026-09-30).","cited_cells":33,"third_party_cells":0,"page":"https://mrpeppersdev.github.io/agent-infrastructure-landscape/systems/figure-ai--figure-ai"},{"id":"friend--friend-com","name":"Friend","url":"https://friend.com","section":"Voice-first / wearable AI memory","tier":1,"status":"active","last_verified_at":"2026-10-28","type":"Always-on AI companion pendant","license":"","latest_release":"","deployment":"Managed-only","pricing":"Hardware-bundled","mcp_support":"searched not found","a2a_support":"searched not found","backend_storage":"custom","github":"","storage":"vector","retrieval":"similarity","persistence":"lifelong","update":"append-only","unit":"episode","governance":"opaque","conflict":"append","description":"Pendant necklace (~2 inches). Always-on listening feeds a persistent AI companion persona. Companionship-framed rather than productivity / recall. Cloud LLM backend; no detailed encryption claims.","cited_cells":36,"third_party_cells":9,"page":"https://mrpeppersdev.github.io/agent-infrastructure-landscape/systems/friend--friend-com"},{"id":"google-deepmind-gemini-robotics--deepmind-google","name":"Google DeepMind Gemini Robotics","url":"https://deepmind.google/models/gemini-robotics/","section":"Robotics foundation models & agent stacks","tier":1,"status":"active","last_verified_at":"2026-10-29","type":"Robotics foundation model from Google DeepMind","license":"","latest_release":"Gemini Robotics 2 (with Gemini Robotics ER 2 and On-Device 2; date not stated on the model page)","deployment":"Trusted-tester via partners; Vertex AI / Cloud planned","pricing":"","mcp_support":"","a2a_support":"Google's own A2A protocol — likely first-party","backend_storage":"Google Cloud","github":"","storage":"","retrieval":"","persistence":"","update":"","unit":"","governance":"","conflict":"","description":"Google DeepMind's Gemini Robotics + Gemini Robotics-ER (Embodied Reasoning) released Mar-2025. VLA models built on Gemini 2.0 backbone. Reference platform: Apptronik Apollo. The DeepMind line of robotics-FM, descendant of earlier RT-1 / RT-2 / RT-X work.","cited_cells":59,"third_party_cells":0,"page":"https://mrpeppersdev.github.io/agent-infrastructure-landscape/systems/google-deepmind-gemini-robotics--deepmind-google"},{"id":"granola--granola-ai","name":"Granola","url":"https://www.granola.ai","section":"Voice-first / wearable AI memory","tier":1,"status":"active","last_verified_at":"2026-10-23","type":"Mac/iOS meeting notepad — system-audio tap","license":"","latest_release":"","deployment":"Managed-only","pricing":"Basic $0; Business $14/user/mo; Enterprise $35/user/mo","mcp_support":"yes — official Granola MCP server on all tiers (Basic: last 30 days of personal notes; Business/Enterprise: workspace notes, admin controls)","a2a_support":"searched not found","backend_storage":"custom","github":"","storage":"file","retrieval":"extraction-pull","persistence":"long-term","update":"append-only","unit":"episode|document","governance":"user-controllable","conflict":"append","description":"Mac/iOS app (no hardware). Captures meeting audio via system-audio tap (no bot joining); generates notes from your shorthand + audio. Local audio processing claim; cloud for summaries. Enterprise tier opts out of model training.","cited_cells":71,"third_party_cells":6,"page":"https://mrpeppersdev.github.io/agent-infrastructure-landscape/systems/granola--granola-ai"},{"id":"highlight-ai--highlightai-com","name":"Highlight AI","url":"https://highlightai.com/","section":"Computer-use & desktop agents","tier":2,"status":"active","last_verified_at":"2026-10-29","type":"Desktop AI co-pilot (always-on context capture across apps)","license":"","latest_release":"v2.0.20 (2026-10-20)","deployment":"Desktop app (Mac + Windows); local + cloud hybrid","pricing":"Free $0/mo (14-day Pro trial); Pro $35/mo; Max $200/mo","mcp_support":"searched not found","a2a_support":"searched not found","backend_storage":"Local SQLite + optional cloud sync","github":"","storage":"","retrieval":"","persistence":"","update":"","unit":"","governance":"","conflict":"","description":"Always-on desktop AI assistant that watches the user's screen (across all apps) and answers questions / takes actions based on what's currently visible. Mac + Windows. Founded by Mac Bishop (ex-Mixpanel); raised $13M Series A from Aspect / Lightspeed (Oct 2024). Distinguishes itself from Rewind by being action-oriented (not just recall). As of 2026-10 the site repositions it as an AI multitasker for work: it captures meeting and work context and drafts follow-ups, daily briefs and end-of-day recaps in connected tools (Gmail, Slack, Linear, GitHub and others).","cited_cells":35,"third_party_cells":0,"page":"https://mrpeppersdev.github.io/agent-infrastructure-landscape/systems/highlight-ai--highlightai-com"},{"id":"hugging-face-lerobot--huggingface-co","name":"Hugging Face LeRobot","url":"https://huggingface.co/lerobot","section":"Robotics foundation models & agent stacks","tier":1,"status":"active","last_verified_at":"2026-10-27","type":"OSS robotics platform on HuggingFace (datasets + models + policies)","license":"Apache-2.0","latest_release":"v0.6.1 (2026-08-03)","deployment":"Self-hosted only — library (pip install lerobot)","pricing":"OSS free; HF Hub free + paid tiers","mcp_support":"","a2a_support":"","backend_storage":"HF Hub for datasets / model weights","github":"huggingface/lerobot — ~28.5k stars, last commit 2026-10","storage":"","retrieval":"","persistence":"","update":"","unit":"","governance":"","conflict":"","description":"Hugging Face's open-source robotics platform — datasets, baselines, training code for imitation learning + diffusion policy + ACT. Launched May 2024; growing rapidly with community contributions (HopeJR, SO-100 arms). LeRobot is the de-facto OSS robotics-ML platform analogous to transformers.","cited_cells":71,"third_party_cells":5,"page":"https://mrpeppersdev.github.io/agent-infrastructure-landscape/systems/hugging-face-lerobot--huggingface-co"},{"id":"hume-evi--hume-ai","name":"Hume EVI","url":"https://dev.hume.ai/voice/docs/speech-to-speech-evi/overview","section":"Voice agent platforms","tier":1,"status":"dead","last_verified_at":"2026-10-29","type":"Empathic voice-AI platform (voice + emotion)","license":"","latest_release":"EVI 3 and EVI 4-mini; the EVI API shuts down on 2026-11-13","deployment":"Cloud-managed","pricing":"Per-minute usage; tiered + Enterprise","mcp_support":"yes — official MCP server (HumeAI/mcp-server-hume)","a2a_support":"searched not found","backend_storage":"Session state in Hume cloud","github":"HumeAI org (SDKs/examples; hume-api-examples ~250 stars, updated 2026-10) — EVI service closed source","storage":"","retrieval":"","persistence":"","update":"","unit":"","governance":"","conflict":"","description":"Hume's Empathic Voice Interface (EVI) — voice agent platform with vocal-affect understanding, using Hume's proprietary speech-prosody models. Hume will shut down the EVI and TTS APIs on 2026-11-13 (announced in its docs). Hume raised $50M Series B Mar-2024 (EQT).","cited_cells":46,"third_party_cells":2,"page":"https://mrpeppersdev.github.io/agent-infrastructure-landscape/systems/hume-evi--hume-ai"},{"id":"hyperbrowser--hyperbrowser-ai","name":"Hyperbrowser","url":"https://www.hyperbrowser.ai/","section":"Computer-use & desktop agents","tier":2,"status":"active","last_verified_at":"2026-10-26","type":"Cloud browser-infrastructure for AI agents (Browserbase competitor)","license":"","latest_release":"Rolling cloud releases","deployment":"Cloud only (no self-host)","pricing":"Per-session-minute + free tier","mcp_support":"yes — official Hyperbrowser MCP server (hyperbrowserai/mcp, MIT)","a2a_support":"searched not found","backend_storage":"Session state in Hyperbrowser-managed Chromium fleet","github":"github.com/hyperbrowserai (client SDKs only)","storage":"","retrieval":"","persistence":"","update":"","unit":"","governance":"","conflict":"","description":"Cloud-hosted headless browser API tuned for AI agents — captcha solving, stealth mode, session recordings. Y Combinator S24; pitched as a faster / cheaper Browserbase alternative. Used as substrate by agents that need browser execution but don't want to run their own Chromium fleet.","cited_cells":46,"third_party_cells":7,"page":"https://mrpeppersdev.github.io/agent-infrastructure-landscape/systems/hyperbrowser--hyperbrowser-ai"},{"id":"k-scale-labs--kscale-dev","name":"K-Scale Labs","url":"https://www.kscale.dev/","section":"Robotics foundation models & agent stacks","tier":3,"status":"stale","last_verified_at":"2026-10-27","type":"Open-source humanoid + OS — Y Combinator W24","license":"MIT (kos); K-Bot software GPL-3.0, hardware CERN-OHL-S","latest_release":"v0.3.18 (2025-09-04) — kscale SDK","deployment":"Hardware ships; OS self-host","pricing":"Hardware kits ($8-16k range); OS free","mcp_support":"","a2a_support":"","backend_storage":"Caller-managed","github":"kscalelabs/kos — ~75 stars, last commit 2025-05","storage":"","retrieval":"","persistence":"","update":"","unit":"","governance":"","conflict":"","description":"Open-source humanoid robot maker — K-Scale OS (Kos), Stompy and KBot humanoids. YC W24. Pitched as the 'open-source humanoid' alternative to Figure / Tesla — full hardware + software OSS.","cited_cells":37,"third_party_cells":4,"page":"https://mrpeppersdev.github.io/agent-infrastructure-landscape/systems/k-scale-labs--kscale-dev"},{"id":"limitless--limitless-ai","name":"Limitless","url":"https://www.limitless.ai/","section":"Voice-first / wearable AI memory","tier":1,"status":"acquired","last_verified_at":"2026-10-29","type":"Wearable pendant + screen capture lifelog","license":"","latest_release":"","deployment":"Managed-only","pricing":"Discontinued — no new sales since 2025-12-05; existing Pendant owners get Unlimited plan free","mcp_support":"via official adapter — Limitless Developer API","a2a_support":"searched not found","backend_storage":"custom","github":"","storage":"file|vector","retrieval":"similarity|extraction-pull","persistence":"lifelong","update":"append-only","unit":"episode|document","governance":"user-controllable","conflict":"append","description":"Former Rewind/Limitless lifelog (Pendant wearable + screen/audio capture with timeline search). Acquired by Meta (2025-12); Pendant no longer sold as of 2025-12-05, service withdrawn from the EU, UK, Brazil, China, Israel, South Korea and Turkey on 2025-12-05, desktop/web recording ended and Rewind capture disabled from 2025-12-19; existing Pendant customers supported throughout 2026.","cited_cells":38,"third_party_cells":5,"page":"https://mrpeppersdev.github.io/agent-infrastructure-landscape/systems/limitless--limitless-ai"},{"id":"livekit-agents--docs-livekit-io","name":"LiveKit Agents","url":"https://docs.livekit.io/agents/","section":"Voice agent platforms","tier":1,"status":"active","last_verified_at":"2026-10-26","type":"Voice-agent framework on LiveKit WebRTC platform","license":"Apache-2.0 (framework); turn-detector models under LiveKit Model License","latest_release":"v1.7.1 (2026-08-27) — livekit-agents (Python)","deployment":"Both (self-hosted + managed cloud) — OSS framework self-host + LiveKit Cloud","pricing":"OSS free; LiveKit Cloud tiered ($50/mo+ + usage)","mcp_support":"yes — native MCP support (agents can use MCP server tools)","a2a_support":"searched not found","backend_storage":"Caller-managed; LiveKit handles WebRTC session state","github":"livekit/agents — ~13k stars, last commit 2026-08+","storage":"","retrieval":"","persistence":"","update":"","unit":"","governance":"","conflict":"","description":"LiveKit Agents — agent framework built on LiveKit's open-source WebRTC media server. LiveKit raised $45M Series B Sep-2024 ($300M val). Powers OpenAI Realtime API's WebRTC transport (LiveKit is the substrate OpenAI chose). Agents framework formally launched 2024.","cited_cells":50,"third_party_cells":2,"page":"https://mrpeppersdev.github.io/agent-infrastructure-landscape/systems/livekit-agents--docs-livekit-io"},{"id":"lutra-ai--lutra-ai","name":"Lutra AI","url":"https://lutra.ai/","section":"Computer-use & desktop agents","tier":2,"status":"archived","last_verified_at":"2026-10-29","type":"AI agent platform for SaaS automations (Gmail/Slack/Sheets)","license":"","latest_release":"","deployment":"Cloud only","pricing":"Free tier + Plus ($20/mo) + Team / Enterprise","mcp_support":"searched not found","a2a_support":"searched not found","backend_storage":"Playbook + run state in Lutra cloud DB","github":"","storage":"","retrieval":"","persistence":"","update":"","unit":"","governance":"","conflict":"","description":"AI agent platform that automated SaaS workflows across Gmail, Slack, Sheets, etc. using natural-language instructions compiled into durable playbooks. Founded by ex-Google/Facebook engineers; raised seed funding 2024. Discontinued: lutra.ai now states support for Lutra has been discontinued (seen 2026-10-27).","cited_cells":36,"third_party_cells":1,"page":"https://mrpeppersdev.github.io/agent-infrastructure-landscape/systems/lutra-ai--lutra-ai"},{"id":"magnitude--magnitude-run","name":"Magnitude","url":"https://magnitude.dev/","section":"Computer-use & desktop agents","tier":3,"status":"deprecated","last_verified_at":"2026-10-29","type":"OSS browser-agent framework for web tests (YC)","license":"Apache-2.0","latest_release":"v0.x ongoing on GitHub","deployment":"Self-hosted only — local library/desktop app","pricing":"OSS free; cloud / enterprise on roadmap","mcp_support":"no — not mentioned in repo","a2a_support":"searched not found","backend_storage":"Local Playwright state","github":"magnitudedev/magnitude — ~7.2k stars, last commit n/a (repo repurposed to inference engine)","storage":"","retrieval":"","persistence":"","update":"","unit":"","governance":"","conflict":"","description":"Formerly an OSS AI browser-agent / natural-language E2E testing framework (YC 2025). The magnitudedev/magnitude repo now hosts an OSS local inference engine + desktop app that serves open models to agents.","cited_cells":40,"third_party_cells":4,"page":"https://mrpeppersdev.github.io/agent-infrastructure-landscape/systems/magnitude--magnitude-run"},{"id":"memories-ai-lvmm-2-0-project-luci--memories-ai","name":"Memories.ai LVMM 2.0 / Project LUCI","url":"https://memories.ai/blog/collaboration-with-qualcomm","section":"Voice-first / wearable AI memory","tier":2,"status":"active","last_verified_at":"2026-10-22","type":"On-device Large Visual Memory Model for wearables","license":"","latest_release":"","deployment":"Hybrid (on-device LVMM 2.0 + cloud companion)","pricing":"Free 100 credits/mo; Plus $15/mo (5,000 credits, annual); Enterprise custom (incl. on-prem); usage API e.g. storage $0.03/GB-mo, search $0.10/1K queries","mcp_support":"searched not found","a2a_support":"searched not found","backend_storage":"Qualcomm SoC + on-device storage + cloud sync","github":"","storage":"vector","retrieval":"similarity","persistence":"long-term","update":"append-only","unit":"episode","governance":"user-controllable","conflict":"none","description":"Developer-first reference platform for AI wearables. LVMM 2.0 captures visual data through video, encodes it into frames on-device, and stores moments as searchable memories; companion app surfaces past conversations/decisions/experiences. Hardware-level security via Qualcomm partnership; cloud sync for enterprise tiers.","cited_cells":37,"third_party_cells":11,"page":"https://mrpeppersdev.github.io/agent-infrastructure-landscape/systems/memories-ai-lvmm-2-0-project-luci--memories-ai"},{"id":"nvidia-gr00t-isaac--developer-nvidia-com","name":"NVIDIA GR00T / Isaac","url":"https://www.nvidia.com/en-us/industries/robotics/isaac-groot/","section":"Robotics foundation models & agent stacks","tier":1,"status":"active","last_verified_at":"2026-10-29","type":"Robotics foundation model + simulation stack (NVIDIA)","license":"Apache-2.0 code; model weights NVIDIA Open Model License","latest_release":"GR00T N1.7 (2026-04-21) — Isaac-GR00T","deployment":"On-robot (Jetson Thor) + simulation (Isaac Sim) + training cloud (Cosmos)","pricing":"OSS weights free; Cosmos / Jetson hardware sold separately","mcp_support":"","a2a_support":"","backend_storage":"Caller-managed (on-robot + cloud)","github":"NVIDIA/Isaac-GR00T — ~8.3k stars, last commit 2026-10","storage":"","retrieval":"","persistence":"","update":"","unit":"","governance":"","conflict":"","description":"NVIDIA Project GR00T (Mar-2024) — general-purpose humanoid foundation model + Isaac simulation stack + Jetson Thor compute. GR00T N1 model released open March 2025. NVIDIA's full-stack play: model + sim + compute + training cloud (Cosmos). Major partners include Figure, Apptronik, Boston Dynamics, Agility.","cited_cells":71,"third_party_cells":2,"page":"https://mrpeppersdev.github.io/agent-infrastructure-landscape/systems/nvidia-gr00t-isaac--developer-nvidia-com"},{"id":"omi--omi-me","name":"Omi","url":"https://www.omi.me","section":"Voice-first / wearable AI memory","tier":1,"status":"active","last_verified_at":"2026-10-22","type":"Open-source wearable orb + memory graph","license":"MIT","latest_release":"v0.12.522+12522-macos (2026-10-22)","deployment":"Both","pricing":"Hardware-bundled","mcp_support":"yes — repo ships an MCP server (mcp/ folder)","a2a_support":"searched not found","backend_storage":"searched not found","github":"BasedHardware/omi — ~13.2k stars, last commit 2026-10","storage":"graph|vector","retrieval":"graph-traversal|similarity","persistence":"lifelong","update":"append-only|consolidation","unit":"episode|fact","governance":"user-controllable","conflict":"append","description":"Wearable orb (necklace or clip) with open-source hardware + firmware. Continuous audio capture; real-time GPT-4o transcription; searchable memory graph. Supports app screen capture too. Hybrid privacy: cloud by default (SOC 2/HIPAA/AES-256), full local/self-hosted available under MIT.","cited_cells":56,"third_party_cells":5,"page":"https://mrpeppersdev.github.io/agent-infrastructure-landscape/systems/omi--omi-me"},{"id":"openai-operator--openai-com","name":"OpenAI Operator","url":"https://openai.com/index/introducing-operator/","section":"Computer-use & desktop agents","tier":1,"status":"deprecated","last_verified_at":"2026-10-31","type":"Consumer computer-use agent (browser-only)","license":"","latest_release":"","deployment":"Cloud (OpenAI-hosted browser sandbox) — no self-host","pricing":"Bundled with ChatGPT Pro $200/mo","mcp_support":"searched not found","a2a_support":"searched not found","backend_storage":"OpenAI-hosted browser session state; no durable cross-session memory by default","github":"","storage":"","retrieval":"","persistence":"","update":"","unit":"","governance":"","conflict":"","description":"OpenAI's general-purpose browser agent — research preview launched January 2025 (US Pro tier). Built on the Computer-Using Agent (CUA) model that processes screenshots and emits mouse / keyboard actions; runs inside an OpenAI-hosted browser sandbox. Operator is the consumer product; the underlying CUA model is the substrate. Superseded by ChatGPT agent (launched 2025-07-17), which absorbed Operator's functionality as agent mode in ChatGPT; operator.chatgpt.com now redirects to ChatGPT agent mode.","cited_cells":57,"third_party_cells":1,"page":"https://mrpeppersdev.github.io/agent-infrastructure-landscape/systems/openai-operator--openai-com"},{"id":"openai-realtime-api--platform-openai-com","name":"OpenAI Realtime API","url":"https://platform.openai.com/docs/guides/realtime","section":"Voice agent platforms","tier":1,"status":"active","last_verified_at":"2026-10-26","type":"Speech-to-speech LLM API (OpenAI Realtime)","license":"","latest_release":"","deployment":"API (Cloud); no self-host","pricing":"Audio token-based: $40/$80 per 1M input/output audio tokens (Oct-2024 launch)","mcp_support":"searched not found","a2a_support":"searched not found","backend_storage":"Stateless session API; caller manages durability","github":"openai/openai-realtime-agents — ~6.9k stars (MIT reference app on Agents SDK), last commit n/a; API itself closed source","storage":"","retrieval":"","persistence":"","update":"","unit":"","governance":"","conflict":"","description":"OpenAI's Realtime API for native speech-to-speech multimodal interaction with GPT-4o — launched Oct 2024 (DevDay). Skips the STT → LLM → TTS pipeline by passing speech directly to GPT-4o. The platform substrate that Vapi/Retell/Bland integrate as one of their LLM choices.","cited_cells":66,"third_party_cells":11,"page":"https://mrpeppersdev.github.io/agent-infrastructure-landscape/systems/openai-realtime-api--platform-openai-com"},{"id":"openmind-om1--openmind-org","name":"OpenMind OM1","url":"https://openmind.com/","section":"Robotics foundation models & agent stacks","tier":3,"status":"active","last_verified_at":"2026-10-29","type":"Open robot OS / agentic framework (FABRIC + OM1)","license":"MIT","latest_release":"OM1 (open robot operating model)","deployment":"Self-hosted only — prebuilt binaries for Linux/macOS or build from source; connects to robot HAL/ROS2 via DDS or websockets","pricing":"OSS free; commercial support paid","mcp_support":"","a2a_support":"","backend_storage":"Caller-managed","github":"OpenMind/OM1 — ~3.0k stars, last commit 2026-10","storage":"","retrieval":"","persistence":"","update":"","unit":"","governance":"","conflict":"","description":"OpenMind — open robot OS (OM1) + FABRIC interconnect, founded by Jan Liphardt (Stanford). Pitched as the 'Android of robots': any humanoid + any LLM + the same OS layer. Raised $20M Series A (Pantera + others, 2025).","cited_cells":42,"third_party_cells":1,"page":"https://mrpeppersdev.github.io/agent-infrastructure-landscape/systems/openmind-om1--openmind-org"},{"id":"otter-ai--otter-ai","name":"Otter.ai","url":"https://otter.ai","section":"Voice-first / wearable AI memory","tier":1,"status":"active","last_verified_at":"2026-10-22","type":"Meeting bot + browser extension + app","license":"","latest_release":"","deployment":"Managed-only","pricing":"Basic free; Pro $16.99/user/mo monthly or $8.33 annual; Business $30 list ($19.99 annual); Enterprise custom","mcp_support":"yes — first-party Otter MCP server (listed in Basic/Pro features); API & webhooks on Enterprise","a2a_support":"not supported","backend_storage":"custom","github":"","storage":"file|vector","retrieval":"similarity|extraction-pull","persistence":"long-term","update":"append-only","unit":"episode|document","governance":"inspectable","conflict":"append","description":"Joins Zoom / Meet / Teams as a meeting bot. Real-time transcription, speaker identification, searchable archive across past meetings. SSO + admin controls at Business tier.","cited_cells":49,"third_party_cells":2,"page":"https://mrpeppersdev.github.io/agent-infrastructure-landscape/systems/otter-ai--otter-ai"},{"id":"physical-intelligence--physicalintelligence-company","name":"Physical Intelligence (π)","url":"https://www.pi.website/","section":"Robotics foundation models & agent stacks","tier":1,"status":"active","last_verified_at":"2026-10-29","type":"Robotics foundation-model lab (π0 / π0.5)","license":"OpenPI Apache 2.0 (Feb 2025 release of weights)","latest_release":"pi0.7 (2026-04-16) — model; openpi repo has no GitHub releases","deployment":"Both (self-hosted + managed cloud) — openpi weights self-hosted; Pi API beta (managed fine-tuning + hosted inference, waitlist) since 2026-10-13","pricing":"","mcp_support":"","a2a_support":"","backend_storage":"Caller manages robot trajectories","github":"Physical-Intelligence/openpi — ~14.4k stars, last commit 2026-08","storage":"","retrieval":"","persistence":"","update":"","unit":"","governance":"","conflict":"","description":"Founded 2024 by Sergey Levine (UC Berkeley) and Karol Hausman + others (ex-Google Brain Robotics). Building general-purpose robot foundation models (π0 released Oct-2024; π0.5 in 2025) trained on cross-embodiment robot trajectories. Raised $400M Series A (Nov-2024; Jeff Bezos, OpenAI, Thrive, Lux) at $2.4B val. Released π0.7 (2026-04-16) and opened its models through the Pi API beta (2026-10-13).","cited_cells":62,"third_party_cells":2,"page":"https://mrpeppersdev.github.io/agent-infrastructure-landscape/systems/physical-intelligence--physicalintelligence-company"},{"id":"pickle-robot--picklerobot-com","name":"Pickle Robot","url":"https://www.picklerobot.com/","section":"Robotics foundation models & agent stacks","tier":3,"status":"active","last_verified_at":"2026-10-27","type":"Warehouse-truck-unloading robot platform (MIT spinout)","license":"","latest_release":"","deployment":"Truck-dock installation; RaaS","pricing":"RaaS / capex","mcp_support":"","a2a_support":"","backend_storage":"Internal cloud","github":"","storage":"","retrieval":"","persistence":"","update":"","unit":"","governance":"","conflict":"","description":"MIT spinout focused on truck-unloading robots — autonomously empties truck trailers. Raised $50M Series B (Mar 2024, Tiger Global + others). Narrow focus but production deployments at major logistics customers.","cited_cells":35,"third_party_cells":1,"page":"https://mrpeppersdev.github.io/agent-infrastructure-landscape/systems/pickle-robot--picklerobot-com"},{"id":"pipecat-daily--pipecat-ai","name":"Pipecat (Daily)","url":"https://www.pipecat.ai/","section":"Voice agent platforms","tier":1,"status":"active","last_verified_at":"2026-10-26","type":"OSS voice-agent framework (Daily.co)","license":"BSD-2-Clause","latest_release":"v1.7.0 (2026-08-01)","deployment":"Both (self-hosted + managed cloud) — pip self-host + Pipecat Cloud","pricing":"OSS free; runs on Daily.co Cloud or self-host","mcp_support":"Composes with MCP tools (caller-side)","a2a_support":"searched not found","backend_storage":"In-memory context; caller adds durability","github":"pipecat-ai/pipecat — ~16.8k stars, last commit 2026-08+","storage":"","retrieval":"","persistence":"","update":"","unit":"","governance":"","conflict":"","description":"Open-source Python framework for real-time voice + multimodal AI agents, maintained by Daily.co. Pipeline-style architecture (STT → context → LLM → TTS) wired over WebRTC. The OSS substrate that many of the voice platforms build on or compose with.","cited_cells":52,"third_party_cells":2,"page":"https://mrpeppersdev.github.io/agent-infrastructure-landscape/systems/pipecat-daily--pipecat-ai"},{"id":"plaud-notepin--plaud-ai","name":"Plaud NotePin","url":"https://www.plaud.ai","section":"Voice-first / wearable AI memory","tier":1,"status":"active","last_verified_at":"2026-10-22","type":"Magnetic clip-on + AI transcription","license":"","latest_release":"","deployment":"Managed-only","pricing":"NotePin $159 / NotePin S $179 / Note Pro $189; Starter plan free (300 min/mo); Pro $17.99/mo or $99.99/yr (1,200 min); Unlimited $29.99/mo or $239.99/yr","mcp_support":"yes — first-party MCP & CLI (docs.plaud.ai) plus device SDK/API","a2a_support":"searched not found","backend_storage":"custom","github":"","storage":"file","retrieval":"extraction-pull","persistence":"long-term","update":"append-only","unit":"episode|document","governance":"user-controllable","conflict":"append","description":"Magnetic clip-on wearable. Records in-person conversations and calls; AI summaries, action items, searchable transcripts. AES-256 + TLS 1.2 in transit; doesn't retain audio after transcription. Also sells Note (card-form recorder) and Note Pro.","cited_cells":37,"third_party_cells":3,"page":"https://mrpeppersdev.github.io/agent-infrastructure-landscape/systems/plaud-notepin--plaud-ai"},{"id":"project-mariner--deepmind-google","name":"Project Mariner","url":"https://labs.google.com/mariner/","section":"Computer-use & desktop agents","tier":1,"status":"archived","last_verified_at":"2026-10-31","type":"Google DeepMind browser-agent (research preview)","license":"","latest_release":"","deployment":"Chrome extension + Google Cloud","pricing":"Bundled with Gemini Advanced ($19.99/mo)","mcp_support":"searched not found","a2a_support":"Google's own A2A protocol — likely first-party compatible","backend_storage":"Google-managed session state","github":"","storage":"","retrieval":"","persistence":"","update":"","unit":"","governance":"","conflict":"","description":"Google DeepMind's experimental browser agent built on Gemini 2.0, a Chrome extension that took actions on the user's behalf. Research preview launched Dec 2024 as Google's answer to OpenAI Operator / Anthropic Computer Use. Shut down on 2026-05-04; Google directs users to Gemini for complex agentic tasks.","cited_cells":57,"third_party_cells":0,"page":"https://mrpeppersdev.github.io/agent-infrastructure-landscape/systems/project-mariner--deepmind-google"},{"id":"read-ai--read-ai","name":"Read.ai","url":"https://www.read.ai","section":"Voice-first / wearable AI memory","tier":1,"status":"active","last_verified_at":"2026-10-22","type":"Meeting bot + analytics + Ada digital twin","license":"","latest_release":"","deployment":"Managed-only","pricing":"Free (5 meetings/mo); Pro $19.75/mo ($15 annual); Enterprise $29.75 ($22.50); Enterprise+ $39.75 ($29.75), per user","mcp_support":"yes — official Read AI MCP server, plus Claude Connector and ChatGPT app","a2a_support":"searched not found","backend_storage":"custom","github":"","storage":"file|vector","retrieval":"similarity|extraction-pull","persistence":"long-term","update":"append-only","unit":"episode|document","governance":"inspectable","conflict":"append","description":"Meeting bot + browser extension. Captures audio + video; engagement scoring (talk-time, sentiment, attention); enterprise search across all past meetings. \"Ada\" digital-twin feature builds an AI memory of work patterns.","cited_cells":45,"third_party_cells":2,"page":"https://mrpeppersdev.github.io/agent-infrastructure-landscape/systems/read-ai--read-ai"},{"id":"retell-ai--retellai-com-2","name":"Retell AI","url":"https://www.retellai.com/","section":"Voice agent platforms","tier":1,"status":"active","last_verified_at":"2026-10-27","type":"Developer platform for AI voice agents (low-latency)","license":"","latest_release":"","deployment":"Cloud-managed","pricing":"Pay-as-you-go $0.07-$0.31/min for voice agents (Retell voice infra $0.055/min plus TTS and LLM components), $10 free credits, 20 concurrent calls included; Enterprise custom","mcp_support":"yes — agents can call MCP tools during live calls","a2a_support":"searched not found","backend_storage":"Call state in Retell-managed DB","github":"github.com/RetellAI (SDKs only)","storage":"","retrieval":"","persistence":"","update":"","unit":"","governance":"","conflict":"","description":"Voice-agent platform with vendor focus on sub-800ms turn latency and proprietary voice models. Y Combinator S24; raised $4.6M seed Aug 2024 (BoxGroup + others); >$1M ARR by month 6 per founders. Direct competitor to Vapi with proprietary-model focus.","cited_cells":46,"third_party_cells":5,"page":"https://mrpeppersdev.github.io/agent-infrastructure-landscape/systems/retell-ai--retellai-com-2"},{"id":"sanctuary-ai--sanctuary-ai","name":"Sanctuary AI","url":"https://sanctuary.ai/","section":"Robotics foundation models & agent stacks","tier":3,"status":"active","last_verified_at":"2026-10-29","type":"General-purpose humanoid (Phoenix) — cognitive-architecture-led","license":"","latest_release":"Phoenix Gen 7 (2023)","deployment":"Direct customer pilot","pricing":"","mcp_support":"","a2a_support":"","backend_storage":"Internal Sanctuary cloud (Carbon arch.)","github":"","storage":"","retrieval":"","persistence":"","update":"","unit":"","governance":"","conflict":"","description":"Vancouver-based Physical AI company, founded 2018; originally built the Phoenix humanoid, and since 2026-06 deploys hardware-agnostic Physical AI on existing commercial industrial robots (Tier 1 automotive proof-of-concept), with hydraulic hands in development.","cited_cells":32,"third_party_cells":1,"page":"https://mrpeppersdev.github.io/agent-infrastructure-landscape/systems/sanctuary-ai--sanctuary-ai"},{"id":"sandbar-stream--sandbar-com","name":"Sandbar Stream","url":"https://www.sandbar.com","section":"Voice-first / wearable AI memory","tier":2,"status":"active","last_verified_at":"2026-10-22","type":"Smart ring + voice-activated capture","license":"","latest_release":"","deployment":"Managed-only; still listed as preorder on site as of Oct 2026","pricing":"Ring preorder $249 (silver) / $299 (gold); Pro subscription $10/mo (free 3mo for preorders)","mcp_support":"yes — first-party Stream MCP server (api.sandbar.com/mcp, OAuth; Claude, Claude Code, ChatGPT, Codex); invite-only beta","a2a_support":"searched not found","backend_storage":"searched not found","github":"","storage":"file","retrieval":"extraction-pull","persistence":"long-term","update":"append-only","unit":"episode","governance":"user-controllable","conflict":"none","description":"Smart ring with voice-activated capture (tap to record, not always-on). Personal knowledge graph with companies, people, meetings; pulls context from past meetings and shared interests. Ex-Meta engineering team.","cited_cells":32,"third_party_cells":5,"page":"https://mrpeppersdev.github.io/agent-infrastructure-landscape/systems/sandbar-stream--sandbar-com"},{"id":"skyvern--skyvern-com","name":"Skyvern","url":"https://www.skyvern.com/","section":"Computer-use & desktop agents","tier":2,"status":"active","last_verified_at":"2026-10-31","type":"OSS browser-automation agent (Python; LLM-driven)","license":"AGPL-3.0","latest_release":"v1.0.56 (2026-10-14)","deployment":"Both (self-hosted + managed cloud) — Docker/pip self-host + Skyvern Cloud (cloud anti-bot features not in OSS)","pricing":"Cloud usage tiers + self-host (free OSS)","mcp_support":"yes — MCP server so any MCP-capable LLM client can drive Skyvern","a2a_support":"searched not found","backend_storage":"PostgreSQL for workflow state","github":"Skyvern-AI/skyvern — ~23.1k stars, last commit 2026-10","storage":"","retrieval":"","persistence":"","update":"","unit":"","governance":"","conflict":"","description":"Open-source autonomous browser agent that uses computer vision + LLMs to navigate websites. Workflow-based: agents follow recorded plans that adapt to layout changes. Skyvern Inc. raised $4.5M seed (Sep-2024, Felicis lead). Self-hostable; cloud version on skyvern.com.","cited_cells":53,"third_party_cells":4,"page":"https://mrpeppersdev.github.io/agent-infrastructure-landscape/systems/skyvern--skyvern-com"},{"id":"speechmatics-flow--speechmatics-com","name":"Speechmatics Flow","url":"https://www.speechmatics.com/voice-agents","section":"Voice agent platforms","tier":2,"status":"deprecated","last_verified_at":"2026-10-29","type":"Conversational voice-agent platform (Speechmatics)","license":"","latest_release":"","deployment":"Cloud + on-prem / private cloud","pricing":"Enterprise / per-minute","mcp_support":"searched not found","a2a_support":"searched not found","backend_storage":"Cloud or on-prem; caller-controlled in on-prem","github":"github.com/speechmatics (SDKs)","storage":"","retrieval":"","persistence":"","update":"","unit":"","governance":"","conflict":"","description":"Speechmatics (UK; STT leader) launched Flow Q4 2024 — conversational voice-agent platform composed on Speechmatics STT + caller LLM. Speechmatics raised $62M Series B (2022); enterprise + media customers. UK / EU data-residency lead. As of 2026-10 the Flow pages and docs redirect to Agent STT, a speech-to-text API for voice agents (Linden model, from $0.30/hour) used via LiveKit, Pipecat or the API; Flow itself is no longer listed.","cited_cells":42,"third_party_cells":1,"page":"https://mrpeppersdev.github.io/agent-infrastructure-landscape/systems/speechmatics-flow--speechmatics-com"},{"id":"stagehand--stagehand-dev","name":"Stagehand","url":"https://www.stagehand.dev/","section":"Computer-use & desktop agents","tier":1,"status":"active","last_verified_at":"2026-10-26","type":"OSS browser-automation framework (Browserbase OSS)","license":"MIT","latest_release":"v3.7.3 (2026-08-28) — @browserbasehq/stagehand","deployment":"Both (self-hosted + managed cloud) — library runs locally; Browserbase cloud browsers optional","pricing":"OSS free; Browserbase Cloud handles runtime","mcp_support":"yes — hosted Browserbase MCP server exposes navigate/act/observe/extract to any MCP client","a2a_support":"searched not found","backend_storage":"Local Playwright state; Browserbase-managed when cloud-hosted","github":"browserbase/stagehand — ~25.5k stars, last commit 2026-08+","storage":"","retrieval":"","persistence":"","update":"","unit":"","governance":"","conflict":"","description":"Open-source browser-automation framework by Browserbase (TypeScript core plus Python and Go SDKs). Mixes Playwright-style code with natural-language act/extract/observe; pairs with Browserbase Cloud.","cited_cells":49,"third_party_cells":7,"page":"https://mrpeppersdev.github.io/agent-infrastructure-landscape/systems/stagehand--stagehand-dev"},{"id":"steel-dev--steel-dev","name":"Steel.dev","url":"https://steel.dev/","section":"Computer-use & desktop agents","tier":2,"status":"active","last_verified_at":"2026-10-26","type":"OSS + cloud browser-infrastructure for AI agents","license":"Apache-2.0","latest_release":"v0.5.4-beta (2026-08-25)","deployment":"Both (self-hosted + managed cloud) — Docker self-host (steel-browser) + Steel Cloud","pricing":"OSS free; Cloud per-session-hour tiers","mcp_support":"searched not found","a2a_support":"searched not found","backend_storage":"Chromium fleet state; Postgres for control plane","github":"steel-dev/steel-browser — ~7.6k stars, last commit 2026-08","storage":"","retrieval":"","persistence":"","update":"","unit":"","governance":"","conflict":"","description":"Open-source browser API ('the browser for agents') — Chromium fleet with stealth mode, session recordings, CDP. OSS repo + managed cloud. Compatible with Playwright / Puppeteer. Distinguishes itself as the 'OSS Browserbase'.","cited_cells":45,"third_party_cells":1,"page":"https://mrpeppersdev.github.io/agent-infrastructure-landscape/systems/steel-dev--steel-dev"},{"id":"synthflow--synthflow-ai","name":"Synthflow","url":"https://synthflow.ai/","section":"Voice agent platforms","tier":2,"status":"active","last_verified_at":"2026-10-27","type":"No-code voice-agent builder (telephony)","license":"","latest_release":"","deployment":"Cloud-managed (EU + US regions)","pricing":"Enterprise contracts from $30,000/yr, scoped by call volume, concurrency, telephony and integrations","mcp_support":"yes — Synthflow MCP server for managing agents, calls and knowledge bases from MCP clients","a2a_support":"searched not found","backend_storage":"Call state in Synthflow-managed DB","github":"","storage":"","retrieval":"","persistence":"","update":"","unit":"","governance":"","conflict":"","description":"No-code voice-AI platform — drag-and-drop call-flow builder targeted at non-developers. Berlin-based; raised $7.4M Series A Sep-2024 (Singular). Distinguishes itself from Vapi/Retell with visual call-flow builder rather than code-first SDK.","cited_cells":41,"third_party_cells":0,"page":"https://mrpeppersdev.github.io/agent-infrastructure-landscape/systems/synthflow--synthflow-ai"},{"id":"toyota-research-institute-lbm--tri-global","name":"Toyota Research Institute LBM","url":"https://www.tri.global/our-work/robotics","section":"Robotics foundation models & agent stacks","tier":1,"status":"active","last_verified_at":"2026-10-29","type":"Robotics research lab — Large Behavior Models (LBM)","license":"Some research code OSS (BSD / MIT)","latest_release":"LBM paper, A Careful Examination of Large Behavior Models for Multitask Dexterous Manipulation (2025-07-07)","deployment":"Research-stage; Toyota internal pilots; OSS code for community","pricing":"","mcp_support":"","a2a_support":"","backend_storage":"Internal TRI / Toyota data centers","github":"ToyotaResearchInstitute (org) — 123 public repos incl. lbm_eval (~125 stars), last activity 2026-10","storage":"","retrieval":"","persistence":"","update":"","unit":"","governance":"","conflict":"","description":"Toyota Research Institute's robotics group — published Large Behavior Models (LBMs) Sep-2023 + diffusion-policy / behavior-cloning at scale. Industrial-research lab with Toyota's manufacturing-data advantage. Not a startup — division of Toyota Motor Corp.","cited_cells":35,"third_party_cells":0,"page":"https://mrpeppersdev.github.io/agent-infrastructure-landscape/systems/toyota-research-institute-lbm--tri-global"},{"id":"ui-tars--gh-bytedance-ui-tars","name":"UI-TARS","url":"https://github.com/bytedance/UI-TARS","section":"Computer-use & desktop agents","tier":2,"status":"active","last_verified_at":"2026-10-31","type":"OSS GUI-agent foundation model + desktop app (ByteDance)","license":"Apache-2.0","latest_release":"UI-TARS-desktop / Agent TARS v0.3.1 (2026-10-09); UI-TARS-2 announced 2025-09-04; latest open weights UI-TARS-1.5-7B (2025-04-16)","deployment":"Self-hosted only — open weights (Hugging Face) + UI-TARS-desktop / Agent TARS app","pricing":"OSS weights free","mcp_support":"yes — via Agent TARS (UI-TARS-desktop): MCP-based kernel that mounts MCP servers","a2a_support":"searched not found","backend_storage":"Caller-side; no built-in storage","github":"bytedance/UI-TARS-desktop — ~39.5k stars, last commit 2026-10 (v0.3.1, 2026-10-09); model repo bytedance/UI-TARS — ~11.7k stars, last commit 2025-09","storage":"","retrieval":"","persistence":"","update":"","unit":"","governance":"","conflict":"","description":"ByteDance Seed's open-source GUI-agent foundation model — released Jan 2025; trained end-to-end on screenshot → action pairs. Comes with UI-TARS-Desktop (Electron app) that runs the model against the user's screen. SOTA on OSWorld at release; weights on HuggingFace.","cited_cells":48,"third_party_cells":3,"page":"https://mrpeppersdev.github.io/agent-infrastructure-landscape/systems/ui-tars--gh-bytedance-ui-tars"},{"id":"vapi--vapi-ai","name":"Vapi","url":"https://vapi.ai/","section":"Voice agent platforms","tier":1,"status":"active","last_verified_at":"2026-10-26","type":"Developer platform for AI voice agents (programmable telephony)","license":"","latest_release":"","deployment":"Cloud-managed; private deployments on Enterprise tier","pricing":"Per-minute usage ($0.05/min base + provider passthrough)","mcp_support":"yes — Vapi MCP server (remote https://mcp.vapi.ai/mcp, Streamable HTTP; VapiAI/mcp-server, MIT); assistants can also call MCP tools","a2a_support":"searched not found","backend_storage":"Call state in Vapi-managed DB; transcripts retained per config","github":"github.com/VapiAI (SDKs only)","storage":"","retrieval":"","persistence":"","update":"","unit":"","governance":"","conflict":"","description":"Voice-AI developer platform — STT + LLM + TTS pipelines wired to telephony (Twilio / SIP). Used to build outbound + inbound phone agents at scale. Raised $20M Series A from Bessemer + Y Combinator (Dec 2024) at $130M valuation; revenue reported >$10M ARR by Q1 2025.","cited_cells":46,"third_party_cells":3,"page":"https://mrpeppersdev.github.io/agent-infrastructure-landscape/systems/vapi--vapi-ai"},{"id":"vonage-ai-studio--vonage-com","name":"Vonage AI Studio","url":"https://www.vonage.com/communications-apis/ai-studio/","section":"Voice agent platforms","tier":2,"status":"acquired","last_verified_at":"2026-10-27","type":"Enterprise CPaaS voice-agent builder (Vonage / Ericsson)","license":"","latest_release":"","deployment":"Cloud-managed","pricing":"Tiered + per-minute / per-message","mcp_support":"searched not found","a2a_support":"searched not found","backend_storage":"Vonage-managed cloud (sessions + flow state)","github":"github.com/Vonage (SDKs)","storage":"","retrieval":"","persistence":"","update":"","unit":"","governance":"","conflict":"","description":"Vonage's AI Studio — visual conversational-agent designer that runs on Vonage CPaaS (SMS / Voice / WhatsApp). Vonage acquired by Ericsson 2022 ($6.2B); AI Studio is the conversational AI layer of the broader CPaaS. Enterprise focus.","cited_cells":40,"third_party_cells":1,"page":"https://mrpeppersdev.github.io/agent-infrastructure-landscape/systems/vonage-ai-studio--vonage-com"}]}