agentgateway
Open-source Rust proxy for AI agents covering LLM routing with credentials and failover, native MCP and A2A traffic, and token-usage limits. Contributors include Solo.io, Microsoft and AWS, and kgateway uses it as its AI data plane.
Active · Verified 2026-10-29 · fresh as of 2026-10-29 · 23 cited facts, 0 with a third-party source · 1 recorded change · Suggest a correction
At a glance
- Tier
- T3
- Section
- Inference platforms & gateways
- Created
- 2025-03-18 repo fix
- Latest release
- last commit 2026-10-28 repo fix
- License
- Apache-2.0 vendor fix
- Pricing
- searched not found fix
- Funding
- searched not found fix
- Freshness
- 2026-10-29 fix
- Layer
- model-infra repo fix
- Licensing
- open-source vendor fix
- Protocols
- a2a, mcp-client, mcp-server, openai-compatible, opentelemetry repo fix
When to use
Optimised for: searched not found
Anti-fit: searched not found
Pros & cons
Pros
searched not found
Cons
searched not found
Claims & capabilities
One high-performance gateway for service, LLM, and MCP traffic.
Technical surface
- API surface
- searched not found
- Backend storage
- searched not found
- Deployment
- searched not found
- Embedding model
- searched not found
- Multi-tenancy
- searched not found
- MCP
- searched not found
- A2A
- searched not found
- OpenTelemetry
- yes
Similar systems
Other inference platforms & gateways in the catalog, ranked by inbound references.
- LiteLLM T1
BerriAI's open-source LLM gateway — unified OpenAI-format API for 100+ providers; LiteLLM Proxy adds budgets, fallbacks, observability, rate-limiting.
- OpenRouter T1
Unified API + marketplace for 300+ models — pay-as-you-go credits, automatic fallback, model arena. Used as default LLM router by many JS/TS agents.
- Together AI T1
Cloud platform for OSS LLM inference and fine-tuning — serverless inference, dedicated endpoints, fine-tuning API, training cluster.
- Fireworks AI T1
Fast inference platform for OSS LLMs — custom Cuda kernels, speculative decoding, multi-LoRA serving. Targets latency-sensitive production use cases.
- vLLM T1
Open-source LLM inference engine with PagedAttention — high-throughput batching, paged KV-cache. UC Berkeley origin; de-facto OSS inference stack.
- Portkey AI T2
AI gateway + observability — load balancing across 200+ LLMs, retries, caching, eval, prompts. Open-source Gateway + commercial Portkey Cloud. Acquired by Palo Alto Networks (closed about 2026-06); now sold as Prisma AIRS AI Gateway (GA 2026-07-16).
Sources (22 cited facts, 0 third-party)
Each fact links to the page it came from; the badge says who published it (how to read sources).
- What it is Framework vendor
- What it does & what's distinct Open-source Rust proxy for AI agents covering LLM routing with credentials and failover,… vendor
- Claims / benefits One high-performance gateway for service, LLM, and MCP traffic. vendor
- Created 2025-03-18 repo
- Latest release last commit 2026-10-28 repo
- License Apache-2.0 vendor
- GitHub https://github.com/agentgateway/agentgateway (5769★) repo
- Mindshare 5769 GitHub stars repo
- OTel yes vendor
- Project & sources https://agentgateway.dev/ ; https://github.com/agentgateway/agentgateway vendor
- obs-langsmith yes vendor
- obs-opentelemetry yes vendor
- obs-datadog yes vendor
- obs-langfuse yes vendor
- obs-arize yes vendor
- cost-semantic-caching yes vendor
- eval-braintrust yes vendor
- eval-weights-and-biases-agent yes vendor
- licensing-bucket open-source vendor
- taxonomy-three-layer-rollup model-infra repo
- sdk-languages rust repo
- protocol-support a2a,mcp-client,mcp-server,openai-compatible,opentelemetry repo
What changed
Changes to this record's lifecycle, licence, release, pricing and hosting facts, from the catalog's git history. Subscribe (Atom)
- 2026-10-30 Added to the catalog #347
Related systems
References (35)
- Agent2Agent Protocol (A2A) integrates with — agentgateway standalone docs have an A2A agent proxying page. (verified 2026-10-29)
- Amazon Bedrock Guardrails integrates with — agentgateway standalone docs have an AWS Bedrock Guardrails prompt-guard page. (verified 2026-10-29)
- Anthropic Claude (foundation models) integrates with — agentgateway standalone docs have an Anthropic Messages API route type page. (verified 2026-10-29)
- Arize AI integrates with — agentgateway integrations docs have a Arize AX observability page. (verified 2026-10-29)
- Arize Phoenix integrates with — agentgateway integrations docs have a Arize Phoenix observability page. (verified 2026-10-29)
- Auth0 for AI Agents integrates with — agentgateway integrations docs have a Auth0 auth page. (verified 2026-10-29)
- Azure AI Content Safety Prompt Shields integrates with — agentgateway standalone docs have an Azure AI Content Safety prompt-guard page. (verified 2026-10-29)
- Baseten integrates with — agentgateway integrations docs have a Baseten provider page. (verified 2026-10-29)
- Bedrock AgentCore (AWS) integrates with — agentgateway standalone docs have a "Connect to AWS Bedrock AgentCore" agent-runtime routing page. (verified 2026-10-29)
- Braintrust integrates with — agentgateway integrations docs have a Braintrust observability page. (verified 2026-10-29)
- Claude Code (Anthropic) integrates with — agentgateway integrations docs have a Claude Code client page. (verified 2026-10-29)
- Cohere Command R+ / Command A integrates with — agentgateway integrations docs have a Cohere provider page. (verified 2026-10-29)
- Continue.dev integrates with — agentgateway integrations docs have a VS Code Continue client page. (verified 2026-10-29)
- Cursor (IDE) integrates with — agentgateway integrations docs have a Cursor client page. (verified 2026-10-29)
- Datadog Agent Observability (LLM Observability) integrates with — agentgateway integrations docs have a Datadog observability page. (verified 2026-10-29)
- DeepSeek R1 / V3 family integrates with — agentgateway integrations docs have a DeepSeek provider page. (verified 2026-10-29)
- Descope Agentic Identity Hub integrates with — agentgateway integrations docs have a Descope auth page. (verified 2026-10-29)
- Fireworks AI integrates with — agentgateway integrations docs have a Fireworks AI provider page. (verified 2026-10-29)
- GitHub Copilot (Agent Mode) integrates with — agentgateway standalone docs have a GitHub Copilot backend-authentication page. (verified 2026-10-29)
- Google Cloud Model Armor integrates with — agentgateway standalone docs have a Google Model Armor prompt-guard page. (verified 2026-10-29)
- Google Gemini 3 family integrates with — agentgateway standalone docs have a native Gemini API route type page. (verified 2026-10-29)
- Goose (Block) integrates with — agentgateway integrations docs have a Goose web UI page. (verified 2026-10-29)
- Langfuse integrates with — agentgateway integrations docs have a Langfuse observability page. (verified 2026-10-29)
- LangSmith integrates with — agentgateway integrations docs have a LangSmith observability page. (verified 2026-10-29)
- LiteLLM integrates with — agentgateway standalone docs have a "Migrate from LiteLLM" config-import page. (verified 2026-10-29)
- Meta Llama 4 family integrates with — agentgateway integrations docs have a Meta (Llama API) provider page. (verified 2026-10-29)
- Mistral Large 2 / Mixtral family integrates with — agentgateway integrations docs have a Mistral AI provider page. (verified 2026-10-29)
- Model Context Protocol (MCP spec) integrates with — agentgateway integrations docs have a MCP page. (verified 2026-10-29)
- Okta Cross App Access (XAA) integrates with — agentgateway standalone docs have a Cross App Access (ID-JAG) token-exchange backend-auth page. (verified 2026-10-29)
- OpenAI Codex CLI integrates with — agentgateway integrations docs have a Codex client page. (verified 2026-10-29)
- OpenAI GPT family (GPT-5 / GPT-4o / o3 / o4) integrates with — agentgateway integrations docs have a OpenAI provider page. (verified 2026-10-29)
- Opencode (SST) integrates with — agentgateway integrations docs have a OpenCode client page. (verified 2026-10-29)
- OpenRouter integrates with — agentgateway integrations docs have a OpenRouter provider page. (verified 2026-10-29)
- Together AI integrates with — agentgateway integrations docs have a Together AI provider page. (verified 2026-10-29)
- xAI Grok 4 integrates with — agentgateway integrations docs have a xAI provider page. (verified 2026-10-29)