TrueFoundry AI Gateway
https://www.truefoundry.com/ai-gateway
Enterprise AI gateway providing unified access to 1,600+ models with policy control, failover, routing, guardrails, budgets and monitoring. It can be deployed in VPC, on-prem or air-gapped environments.
Active · Verified 2026-10-29 · fresh as of 2026-10-29 · 13 cited facts, 0 with a third-party source · 1 recorded change · Suggest a correction
At a glance
- Tier
- T3
- Section
- Inference platforms & gateways
- Created
- searched not found fix
- Latest release
- searched not found fix
- License
- proprietary vendor fix
- GitHub
- not applicable — no GitHub repo fix
- Pricing
- searched not found fix
- Funding
- searched not found fix
- Freshness
- 2026-10-29 fix
- Layer
- model-infra repo fix
- Licensing
- commercial vendor fix
- Protocols
- a2a, mcp-client, mcp-server vendor fix
- Compliance
- gdpr, hipaa vendor fix
When to use
Optimised for: searched not found
Anti-fit: searched not found
Pros & cons
Pros
searched not found
Cons
searched not found
Claims & capabilities
We’re sharing complimentary access to the full Gartner Hype Cycle for AI Governance 2026. Get your copy →
Technical surface
- API surface
- searched not found
- Backend storage
- searched not found
- Deployment
- searched not found
- Embedding model
- searched not found
- Multi-tenancy
- searched not found
- MCP
- searched not found
- A2A
- searched not found
- OpenTelemetry
- searched not found
Similar systems
Other inference platforms & gateways in the catalog, ranked by inbound references.
- LiteLLM T1
BerriAI's open-source LLM gateway — unified OpenAI-format API for 100+ providers; LiteLLM Proxy adds budgets, fallbacks, observability, rate-limiting.
- OpenRouter T1
Unified API + marketplace for 300+ models — pay-as-you-go credits, automatic fallback, model arena. Used as default LLM router by many JS/TS agents.
- Together AI T1
Cloud platform for OSS LLM inference and fine-tuning — serverless inference, dedicated endpoints, fine-tuning API, training cluster.
- Fireworks AI T1
Fast inference platform for OSS LLMs — custom Cuda kernels, speculative decoding, multi-LoRA serving. Targets latency-sensitive production use cases.
- vLLM T1
Open-source LLM inference engine with PagedAttention — high-throughput batching, paged KV-cache. UC Berkeley origin; de-facto OSS inference stack.
- Portkey AI T2
AI gateway + observability — load balancing across 200+ LLMs, retries, caching, eval, prompts. Open-source Gateway + commercial Portkey Cloud. Acquired by Palo Alto Networks (closed about 2026-06); now sold as Prisma AIRS AI Gateway (GA 2026-07-16).
Sources (12 cited facts, 0 third-party)
Each fact links to the page it came from; the badge says who published it (how to read sources).
- What it is Product vendor
- What it does & what's distinct Enterprise AI gateway providing unified access to 1,600+ models with policy control, fai… vendor
- Claims / benefits We’re sharing complimentary access to the full Gartner Hype Cycle for AI Governance 2026… vendor
- License proprietary vendor
- Project & sources https://www.truefoundry.com/ai-gateway vendor
- obs-datadog yes vendor
- cost-token-budget yes vendor
- cost-prompt-caching yes vendor
- licensing-bucket commercial vendor
- taxonomy-three-layer-rollup model-infra repo
- compliance-certifications gdpr,hipaa vendor
- protocol-support a2a,mcp-client,mcp-server vendor
What changed
Changes to this record's lifecycle, licence, release, pricing and hosting facts, from the catalog's git history. Subscribe (Atom)
- 2026-10-30 Added to the catalog #347
Related systems
References (55)
- Amazon Bedrock Guardrails integrates with — TrueFoundry AI Gateway ecosystem lists a AWS Bedrock Guardrails integration page. (verified 2026-10-29)
- Anthropic Claude (foundation models) integrates with — TrueFoundry AI Gateway docs have a Anthropic model-provider page. (verified 2026-10-29)
- Arize AI integrates with — TrueFoundry AI Gateway ecosystem lists a Arize integration page. (verified 2026-10-29)
- Arthur Engine integrates with — TrueFoundry AI Gateway ecosystem lists a Arthur AI guardrails integration page. (verified 2026-10-29)
- AWS SageMaker integrates with — TrueFoundry AI Gateway docs have a AWS SageMaker model-provider page. (verified 2026-10-29)
- Azure AI Content Safety Prompt Shields integrates with — TrueFoundry AI Gateway ecosystem lists a Azure Content Safety guardrails integration page. (verified 2026-10-29)
- Braintrust integrates with — TrueFoundry AI Gateway ecosystem lists a Braintrust integration page. (verified 2026-10-29)
- Browserbase integrates with — TrueFoundry AI Gateway ecosystem lists a Browserbase MCP server integration page. (verified 2026-10-29)
- Calypso AI (now F5 AI Guardrails) integrates with — TrueFoundry AI Gateway ecosystem lists a F5 CalypsoAI guardrails integration page. (verified 2026-10-29)
- Cartesia Sonic integrates with — TrueFoundry AI Gateway docs have a Cartesia model-provider page. (verified 2026-10-29)
- Cline (harness) integrates with — TrueFoundry AI Gateway ecosystem lists a Cline integration page. (verified 2026-10-29)
- Cohere Command R+ / Command A integrates with — TrueFoundry AI Gateway docs have a Cohere model-provider page. (verified 2026-10-29)
- Comet ML integrates with — TrueFoundry AI Gateway ecosystem lists a Comet Opik integration page. (verified 2026-10-29)
- Confident AI / DeepEval integrates with — TrueFoundry AI Gateway ecosystem lists a Confident AI integration page. (verified 2026-10-29)
- CrewAI integrates with — TrueFoundry AI Gateway ecosystem lists a CrewAI integration page. (verified 2026-10-29)
- CrowdStrike Falcon Guardian (formerly Pangea AI Guard) integrates with — TrueFoundry AI Gateway ecosystem lists a CrowdStrike guardrails integration page. (verified 2026-10-29)
- Cursor (IDE) integrates with — TrueFoundry AI Gateway ecosystem lists a Cursor integration page. (verified 2026-10-29)
- Dify integrates with — TrueFoundry AI Gateway ecosystem lists a Dify integration page. (verified 2026-10-29)
- DSPy integrates with — TrueFoundry AI Gateway ecosystem lists a DSPy integration page. (verified 2026-10-29)
- Fireworks AI integrates with — TrueFoundry AI Gateway ecosystem lists a Fireworks integration page. (verified 2026-10-29)
- Flowise Memory integrates with — TrueFoundry AI Gateway ecosystem lists a Flowise integration page. (verified 2026-10-29)
- GitHub Copilot (Agent Mode) integrates with — TrueFoundry AI Gateway ecosystem lists a GitHub Copilot integration page. (verified 2026-10-29)
- Google Cloud Model Armor integrates with — TrueFoundry AI Gateway ecosystem lists a Google Model Armor integration page. (verified 2026-10-29)
- Google Gemini 3 family integrates with — TrueFoundry AI Gateway docs have a Google Gemini model-provider page. (verified 2026-10-29)
- Goose (Block) integrates with — TrueFoundry AI Gateway ecosystem lists a Goose integration page. (verified 2026-10-29)
- Guardrails AI integrates with — TrueFoundry AI Gateway ecosystem lists a Guardrails AI integration page. (verified 2026-10-29)
- HoneyHive integrates with — TrueFoundry AI Gateway ecosystem lists a HoneyHive integration page. (verified 2026-10-29)
- Jamba (AI21 Labs) integrates with — TrueFoundry AI Gateway docs have a AI21 model-provider page. (verified 2026-10-29)
- Laminar integrates with — TrueFoundry AI Gateway ecosystem lists a Laminar integration page. (verified 2026-10-29)
- LangChain (framework) integrates with — TrueFoundry AI Gateway ecosystem lists a LangChain integration page. (verified 2026-10-29)
- Langflow integrates with — TrueFoundry AI Gateway ecosystem lists a Langflow integration page. (verified 2026-10-29)
- Langfuse integrates with — TrueFoundry AI Gateway ecosystem lists a Langfuse integration page. (verified 2026-10-29)
- LangSmith integrates with — TrueFoundry AI Gateway ecosystem lists a LangSmith integration page. (verified 2026-10-29)
- LiveKit Agents integrates with — TrueFoundry AI Gateway ecosystem lists a LiveKit integration page. (verified 2026-10-29)
- Mistral Large 2 / Mixtral family integrates with — TrueFoundry AI Gateway docs have a Mistral AI model-provider page. (verified 2026-10-29)
- n8n (AI agent flows) integrates with — TrueFoundry AI Gateway ecosystem lists a n8n integration page. (verified 2026-10-29)
- Neo4j integrates with — TrueFoundry AI Gateway ecosystem lists a Neo4j MCP server integration page. (verified 2026-10-29)
- NVIDIA NeMo Guardrails integrates with — TrueFoundry AI Gateway ecosystem lists a NVIDIA NeMo Guardrails integration page. (verified 2026-10-29)
- OpenAI Agents SDK integrates with — TrueFoundry AI Gateway ecosystem lists a OpenAI Agents SDK integration page. (verified 2026-10-29)
- OpenAI Codex CLI integrates with — TrueFoundry AI Gateway ecosystem lists a OpenAI Codex CLI integration page. (verified 2026-10-29)
- OpenAI GPT family (GPT-5 / GPT-4o / o3 / o4) integrates with — TrueFoundry AI Gateway docs have a OpenAI model-provider page. (verified 2026-10-29)
- OpenAI Swarm (deprecated) integrates with — TrueFoundry AI Gateway ecosystem lists a OpenAI Swarm integration page. (verified 2026-10-29)
- Opencode (SST) integrates with — TrueFoundry AI Gateway ecosystem lists a OpenCode integration page. (verified 2026-10-29)
- OpenLLMetry (Traceloop) integrates with — TrueFoundry AI Gateway ecosystem lists a Traceloop integration page. (verified 2026-10-29)
- OpenRouter integrates with — TrueFoundry AI Gateway docs have a OpenRouter model-provider page. (verified 2026-10-29)
- Patronus AI integrates with — TrueFoundry AI Gateway ecosystem lists a Patronus integration page. (verified 2026-10-29)
- Phidata (now Agno) integrates with — TrueFoundry AI Gateway ecosystem lists a Agno integration page. (verified 2026-10-29)
- PromptLayer integrates with — TrueFoundry AI Gateway ecosystem lists a PromptLayer integration page. (verified 2026-10-29)
- Pydantic-AI integrates with — TrueFoundry AI Gateway ecosystem lists a Pydantic AI integration page. (verified 2026-10-29)
- Pydantic Logfire integrates with — TrueFoundry AI Gateway ecosystem lists a Pydantic Logfire integration page. (verified 2026-10-29)
- Roo Code integrates with — TrueFoundry AI Gateway ecosystem lists a Roo Code integration page. (verified 2026-10-29)
- Strands Agents (AWS) integrates with — TrueFoundry AI Gateway ecosystem lists a Strands Agents integration page. (verified 2026-10-29)
- Together AI integrates with — TrueFoundry AI Gateway docs have a Together AI model-provider page. (verified 2026-10-29)
- Weights & Biases integrates with — TrueFoundry AI Gateway ecosystem lists a CoreWeave W&B Weave guardrails integration page. (verified 2026-10-29)
- xAI Grok 4 integrates with — TrueFoundry AI Gateway docs have a xAI model-provider page. (verified 2026-10-29)
Referenced by (3)
- Arthur Engine integrates with — Arthur Engine repo has an integrations/truefoundry integration. (verified 2026-10-29)
- CrewAI integrates with — CrewAI observability docs have a TrueFoundry integration page. (verified 2026-10-29)
- HoneyHive integrates with — HoneyHive integrations docs have a TrueFoundry tracing/integration page. (verified 2026-10-29)