Baseten
Inference platform for ML models — Truss package format, Chains for multi-model workflows, autoscaling GPU/CPU serving. Targeted at production teams shipping LLM/diffusion endpoints.
Active · Verified 2026-10-27 · fresh as of 2026-10-27 · 24 cited facts, 1 with a third-party source · 1 recorded change · Suggest a correction
At a glance
- Type
- ML model serving cloud vendor fix
- Tier
- T1
- Section
- Inference platforms & gateways
- Latest release
- v0.18.36 (2026-10-21) — truss registry fix
- License
- proprietary; Truss MIT repo fix
- Pricing
- Basic $0/mo pay-as-you-go; dedicated deployments billed per GPU-minute (e.g. H100 $0.10833/min); Model APIs per 1M tokens; Pro and Enterprise by quote vendor fix
- Freshness
- 2026-10-27 fix
- Layer
- model-infra repo fix
- Licensing
- commercial repo fix
- SDK languages
- python, rest vendor fix
- Protocols
- openai-compatible vendor fix
- Compliance
- ccpa, gdpr, hipaa, iso27001, pci-dss, soc2-type2, soc3 vendor fix
- Developer activity
- OpenRank 6.07 (12-mo avg 15.18) · 28 participants — 2026-09 third-party fix
When to use
Optimised for: searched not found
Anti-fit: searched not found
Pros & cons
Pros
searched not found
Cons
searched not found
Claims & capabilities
$75M Series C 2025-03 at $825M val (IVP led); $40M Series B 2024.
Technical surface
- API surface
- Baseten CLI, Truss (Python), inference/management/training APIs, OpenAI-compatible Model APIs
- Backend storage
- not applicable — not a memory product
- Deployment
- Both (self-hosted + managed cloud) — Baseten Cloud, self-hosted in your VPC (Enterprise), or hybrid
- Embedding model
- not applicable — not a memory product
- Multi-tenancy
- searched not found
- MCP
- yes — Baseten MCP servers and skill for agents to manage the workspace and search docs
- A2A
- searched not found
- OpenTelemetry
- searched not found
Similar systems
Other inference platforms & gateways in the catalog, ranked by inbound references.
- LiteLLM T1
BerriAI's open-source LLM gateway — unified OpenAI-format API for 100+ providers; LiteLLM Proxy adds budgets, fallbacks, observability, rate-limiting.
- OpenRouter T1
Unified API + marketplace for 300+ models — pay-as-you-go credits, automatic fallback, model arena. Used as default LLM router by many JS/TS agents.
- Together AI T1
Cloud platform for OSS LLM inference and fine-tuning — serverless inference, dedicated endpoints, fine-tuning API, training cluster.
- Fireworks AI T1
Fast inference platform for OSS LLMs — custom Cuda kernels, speculative decoding, multi-LoRA serving. Targets latency-sensitive production use cases.
- vLLM T1
Open-source LLM inference engine with PagedAttention — high-throughput batching, paged KV-cache. UC Berkeley origin; de-facto OSS inference stack.
- Portkey AI T2
AI gateway + observability — load balancing across 200+ LLMs, retries, caching, eval, prompts. Open-source Gateway + commercial Portkey Cloud. Acquired by Palo Alto Networks (closed about 2026-06); now sold as Prisma AIRS AI Gateway (GA 2026-07-16).
Sources (23 cited facts, 1 third-party)
Each fact links to the page it came from; the badge says who published it (how to read sources).
- What it is ML model serving cloud vendor
- What it does & what's distinct Inference platform for ML models — Truss package format, Chains for multi-model workflow… vendor
- Claims / benefits $75M Series C 2025-03 at $825M val (IVP led); $40M Series B 2024. vendor
- Created 2019 vendor
- Latest release v0.18.36 (2026-10-21) — truss registry
- License proprietary; Truss MIT repo
- GitHub basetenlabs/truss — ~1.2k stars, last commit 2026-10 repo
- Funding $135M total raised through Series C 2024-12 ($75M, IVP led; $825M valuation). vendor
- Customers / scale Bland.ai, Patreon, Descript, Writer, Picnic, Wispr Flow; production inference platform. vendor
- Pricing Basic $0/mo pay-as-you-go; dedicated deployments billed per GPU-minute (e.g. H100 $0.108… vendor
- Deployment Both (self-hosted + managed cloud) — Baseten Cloud, self-hosted in your VPC (Enterprise)… vendor
- HQ San Francisco, CA, USA. vendor
- Founders / pedigree Tuhin Srivastava (CEO), Amir Haghighat, Philip Howes; founded 2019 (ex-Gumroad team). vendor
- API surface Baseten CLI, Truss (Python), inference/management/training APIs, OpenAI-compatible Model… vendor
- MCP support yes — Baseten MCP servers and skill for agents to manage the workspace and search docs vendor
- architecture-deployment-locus cloud vendor
- licensing-bucket commercial repo
- positioning-platform-vs-product platform vendor
- taxonomy-three-layer-rollup model-infra repo
- developer-activity-opendigger {"activity":70.71,"as_of":"2026-09","openrank_12mo":15.18,"openrank_current":6.07,"parti… third-party
- compliance-certifications ccpa,gdpr,hipaa,iso27001,pci-dss,soc2-type2,soc3 vendor
- sdk-languages python,rest vendor
- protocol-support openai-compatible vendor
What changed
Changes to this record's lifecycle, licence, release, pricing and hosting facts, from the catalog's git history. Subscribe (Atom)
- 2026-10-27
- License first recorded as “proprietary; Truss MIT” source
- Latest release first recorded as “v0.18.36 (2026-10-21) — truss” source
- Pricing first recorded as “Basic $0/mo pay-as-you-go; dedicated deployments billed per GPU-minute (e.g. H100 $0.10833/min); Model APIs per 1M tokens; Pro and Enterprise by quote” source
- Deployment first recorded as “Both (self-hosted + managed cloud) — Baseten Cloud, self-hosted in your VPC (Enterprise), or hybrid” source
- MCP support first recorded as “yes — Baseten MCP servers and skill for agents to manage the workspace and search docs” source
Related systems
Referenced by (13)
- agentgateway integrates with — agentgateway integrations docs have a Baseten provider page. (verified 2026-10-29)
- Braintrust integrates with — Braintrust docs have a Baseten integration page. (verified 2026-10-29)
- Chroma integrates with — Chroma's docs have a Baseten integration page. (verified 2026-10-29)
- Cloudflare AI Gateway integrates with — Cloudflare AI Gateway docs have a Baseten provider page. (verified 2026-10-29)
- LangChain (framework) integrates with — LangChain docs have a Baseten integration provider page (ML model deployment and serving platform). (verified 2026-10-29)
- Langfuse integrates with — Langfuse's integrations directory has a Baseten integration page. (verified 2026-10-29)
- LiteLLM integrates with — LiteLLM docs have a Baseten provider page. (verified 2026-10-29)
- LiveKit Agents integrates with — LiveKit Agents docs have a Baseten model plugin page. (verified 2026-10-29)
- LlamaIndex (framework) integrates with — LlamaIndex has an official LLM integration package llama-index-llms-baseten in its repo. (verified 2026-10-29)
- OpenRouter integrates with — OpenRouter lists BaseTen as an inference provider (providers API slug "baseten"). (verified 2026-10-29)
- Pipecat (Daily) integrates with — Pipecat docs have a Baseten service page. (verified 2026-10-29)
- Temporal integrates with — Temporal integrations catalog lists Baseten model-provider integration (OpenAI Agents SDK agents on Baseten-served models). (verified 2026-10-29)
- Vercel AI SDK integrates with — AI SDK docs have a Baseten official AI SDK provider page. (verified 2026-10-29)