Portkey AI alternatives

AI gateway + observability — load balancing across 200+ LLMs, retries, caching, eval, prompts. Open-source Gateway + commercial Portkey Cloud. Acquired by Palo Alto Networks (closed about 2026-06); now sold as Prisma AIRS AI Gateway (GA 2026-07-16). Full Portkey AI record →

  1. 1 LiteLLM Inference platforms & gateways

    also in Inference platforms & gateways · also open source · also self-hostable · also offered managed · also has MCP

    OSS ✓ Self-host ✓ Managed ✓ MCP ✓ ★ 62k released 2026-10-25 MIT (except enterprise/ directory, commercial… Compare with Portkey AI →

  2. 2 vLLM Inference platforms & gateways

    also in Inference platforms & gateways · also open source · also self-hostable · also offered managed

    OSS ✓ Self-host ✓ Managed ✓ MCP ? ★ 95k released 2026-10-18 Apache-2.0 Compare with Portkey AI →

  3. 3 TensorRT-LLM Inference platforms & gateways

    also in Inference platforms & gateways · also open source · also self-hostable · also offered managed

    OSS ✓ Self-host ✓ Managed ✓ MCP ? ★ 15k released 2026-04-20 Apache-2.0 Compare with Portkey AI →

  4. 4 SGLang Inference platforms & gateways

    also in Inference platforms & gateways · also open source · also self-hostable · also offered managed

    OSS ✓ Self-host ✓ Managed ✓ MCP ? ★ 38k released 2026-10-16 Apache-2.0 Compare with Portkey AI →

  5. 5 Baseten Inference platforms & gateways

    also in Inference platforms & gateways · also self-hostable · also offered managed · also has MCP

    OSS — Self-host ✓ Managed ✓ MCP ✓ ★ 1.2k released 2026-10-21 proprietary; Truss MIT Compare with Portkey AI →

  6. 6 Bifrost (Maxim AI) Inference platforms & gateways

    also in Inference platforms & gateways · also open source · also self-hostable · also has MCP

    OSS ✓ Self-host ✓ Managed ? MCP ✓ ★ 9.2k released 2026-10-29 Apache-2.0 Compare with Portkey AI →

  7. 7 agentgateway Inference platforms & gateways

    also in Inference platforms & gateways · also open source · also self-hostable · also has MCP

    OSS ✓ Self-host ✓ Managed ? MCP ✓ ★ 5.8k released 2026-10-28 Apache-2.0 Compare with Portkey AI →

  8. 8 Anyscale Inference platforms & gateways

    also in Inference platforms & gateways · also self-hostable · also offered managed

    OSS — Self-host ✓ Managed ✓ MCP ? ★ 44k released 2026-10-20 proprietary; Ray Apache-2.0 Compare with Portkey AI →

Ranked by shared memory design (storage, retrieval, conflict handling, memory unit), same section and shared must-haves (open source, self-hosting, MCP), with adoption as a tie-breaker. ✓ confirmed · — no · ? not in the catalog yet. Want picks for your own requirements? Use the chooser. Checking a whole project? Check your stack.