Cloudflare AI Gateway
https://developers.cloudflare.com/ai-gateway/
Gateway in front of 20+ model providers with an OpenAI-compatible unified API, caching, rate and spend limits, dynamic routing, guardrails, DLP and BYOK, plus logging and analytics.
Active · Verified 2026-10-29 · fresh as of 2026-10-29 · 14 cited facts, 0 with a third-party source · 1 recorded change · Suggest a correction
At a glance
- Tier
- T3
- Section
- Inference platforms & gateways
- Created
- searched not found fix
- Latest release
- searched not found fix
- License
- proprietary vendor fix
- GitHub
- not applicable — no GitHub repo fix
- Pricing
- searched not found fix
- Funding
- searched not found fix
- Freshness
- 2026-10-29 fix
- Layer
- model-infra repo fix
- Licensing
- commercial vendor fix
- Protocols
- openai-compatible, opentelemetry vendor fix
- Compliance
- csa-star, gdpr, iso27001, iso27017, iso27018, iso27701, soc2-type2 vendor fix
When to use
Optimised for: searched not found
Anti-fit: searched not found
Pros & cons
Pros
searched not found
Cons
searched not found
Claims & capabilities
Observe and control your AI applications.
Technical surface
- API surface
- searched not found
- Backend storage
- searched not found
- Deployment
- searched not found
- Embedding model
- searched not found
- Multi-tenancy
- searched not found
- MCP
- searched not found
- A2A
- searched not found
- OpenTelemetry
- yes
Similar systems
Other inference platforms & gateways in the catalog, ranked by inbound references.
- LiteLLM T1
BerriAI's open-source LLM gateway — unified OpenAI-format API for 100+ providers; LiteLLM Proxy adds budgets, fallbacks, observability, rate-limiting.
- OpenRouter T1
Unified API + marketplace for 300+ models — pay-as-you-go credits, automatic fallback, model arena. Used as default LLM router by many JS/TS agents.
- Together AI T1
Cloud platform for OSS LLM inference and fine-tuning — serverless inference, dedicated endpoints, fine-tuning API, training cluster.
- Fireworks AI T1
Fast inference platform for OSS LLMs — custom Cuda kernels, speculative decoding, multi-LoRA serving. Targets latency-sensitive production use cases.
- vLLM T1
Open-source LLM inference engine with PagedAttention — high-throughput batching, paged KV-cache. UC Berkeley origin; de-facto OSS inference stack.
- Portkey AI T2
AI gateway + observability — load balancing across 200+ LLMs, retries, caching, eval, prompts. Open-source Gateway + commercial Portkey Cloud. Acquired by Palo Alto Networks (closed about 2026-06); now sold as Prisma AIRS AI Gateway (GA 2026-07-16).
Sources (13 cited facts, 0 third-party)
Each fact links to the page it came from; the badge says who published it (how to read sources).
- What it is Product vendor
- What it does & what's distinct Gateway in front of 20+ model providers with an OpenAI-compatible unified API, caching, … vendor
- Claims / benefits Observe and control your AI applications. vendor
- License proprietary vendor
- OTel yes vendor
- Project & sources https://developers.cloudflare.com/ai-gateway/ vendor
- obs-opentelemetry yes vendor
- licensing-bucket commercial vendor
- taxonomy-three-layer-rollup model-infra repo
- compliance-certifications csa-star,gdpr,iso27001,iso27017,iso27018,iso27701,soc2-type2 vendor
- sdk-languages rest vendor
- protocol-support openai-compatible,opentelemetry vendor
- maturity ga vendor
What changed
Changes to this record's lifecycle, licence, release, pricing and hosting facts, from the catalog's git history. Subscribe (Atom)
- 2026-10-30 Added to the catalog #347
Related systems
References (17)
- Anthropic Claude (foundation models) integrates with — Cloudflare AI Gateway docs have a Anthropic provider page. (verified 2026-10-29)
- Baseten integrates with — Cloudflare AI Gateway docs have a Baseten provider page. (verified 2026-10-29)
- Cartesia Sonic integrates with — Cloudflare AI Gateway docs have a Cartesia provider page. (verified 2026-10-29)
- Claude Code (Anthropic) integrates with — Cloudflare AI Gateway integrations docs have a Claude Code page. (verified 2026-10-29)
- Cohere Command R+ / Command A integrates with — Cloudflare AI Gateway docs have a Cohere provider page. (verified 2026-10-29)
- Cursor (IDE) integrates with — Cloudflare AI Gateway integrations docs have a Cursor page. (verified 2026-10-29)
- DeepSeek R1 / V3 family integrates with — Cloudflare AI Gateway docs have a DeepSeek provider page. (verified 2026-10-29)
- GitHub Copilot (Agent Mode) integrates with — Cloudflare AI Gateway integrations docs have a GitHub Copilot CLI page. (verified 2026-10-29)
- Google Gemini 3 family integrates with — Cloudflare AI Gateway docs have a Google AI Studio (Gemini) provider page. (verified 2026-10-29)
- Mistral Large 2 / Mixtral family integrates with — Cloudflare AI Gateway docs have a Mistral AI provider page. (verified 2026-10-29)
- OpenAI Codex CLI integrates with — Cloudflare AI Gateway integrations docs have a OpenAI Codex page. (verified 2026-10-29)
- OpenAI GPT family (GPT-5 / GPT-4o / o3 / o4) depends on at runtime — Gateway in front of 20+ model providers with an OpenAI-compatible unified API, caching, rate and spend limits, dynamic routing, guardrails, DLP and BYOK, plus logging and analytics.
- Opencode (SST) integrates with — Cloudflare AI Gateway integrations docs have a OpenCode page. (verified 2026-10-29)
- OpenRouter integrates with — Cloudflare AI Gateway docs have a OpenRouter provider page. (verified 2026-10-29)
- Replicate integrates with — Cloudflare AI Gateway docs have a Replicate provider page. (verified 2026-10-29)
- Vercel AI SDK integrates with — Cloudflare AI Gateway integrations docs have a Vercel AI SDK page. (verified 2026-10-29)
- xAI Grok 4 integrates with — Cloudflare AI Gateway docs have a xAI (Grok) provider page. (verified 2026-10-29)
Referenced by (1)
- HoneyHive integrates with — HoneyHive integrations docs have a Cloudflare AI Gateway tracing/integration page. (verified 2026-10-29)