RunPod
GPU-cloud platform — Pods (long-running), Serverless (per-request), and Hub (community templates). Popular for fine-tuning and inference of OSS models.
Active · Verified 2026-10-27 · fresh as of 2026-10-27 · 18 cited facts, 1 with a third-party source · 1 recorded change · Suggest a correction
At a glance
- Type
- GPU cloud for AI vendor fix
- Tier
- T2
- Section
- Inference platforms & gateways
- Latest release
- v1.12.0 (2026-08-10) — runpod (Python SDK) registry fix
- License
- proprietary; Python SDK MIT registry fix
- GitHub
- searched not found vendor fix
- Pricing
- Pay-as-you-go per-second or per-hour GPU billing; e.g. H100 PCIe Pod $2.89/hr, H100 SXM Pod $3.99/hr (Secure Cloud), Serverless H100 $4.79/hr; reserved capacity via sales vendor fix
- Freshness
- 2026-10-27 fix
- Layer
- model-infra repo fix
- Licensing
- commercial registry fix
- SDK languages
- go, python, rest, typescript vendor fix
- Compliance
- gdpr, hipaa, iso27001, soc2-type2, soc3 vendor fix
When to use
Optimised for: searched not found
Anti-fit: searched not found
Pros & cons
Pros
searched not found
Cons
searched not found
Claims & capabilities
searched not found
Technical surface
- API surface
- searched not found
- Backend storage
- not applicable — not a memory product
- Deployment
- Managed-only — GPU cloud (Pods, Serverless, Clusters)
- Embedding model
- not applicable — not a memory product
- Multi-tenancy
- searched not found
- MCP
- searched not found
- A2A
- searched not found
- OpenTelemetry
- searched not found
Similar systems
Other inference platforms & gateways in the catalog, ranked by inbound references.
- LiteLLM T1
BerriAI's open-source LLM gateway — unified OpenAI-format API for 100+ providers; LiteLLM Proxy adds budgets, fallbacks, observability, rate-limiting.
- OpenRouter T1
Unified API + marketplace for 300+ models — pay-as-you-go credits, automatic fallback, model arena. Used as default LLM router by many JS/TS agents.
- Together AI T1
Cloud platform for OSS LLM inference and fine-tuning — serverless inference, dedicated endpoints, fine-tuning API, training cluster.
- Fireworks AI T1
Fast inference platform for OSS LLMs — custom Cuda kernels, speculative decoding, multi-LoRA serving. Targets latency-sensitive production use cases.
- vLLM T1
Open-source LLM inference engine with PagedAttention — high-throughput batching, paged KV-cache. UC Berkeley origin; de-facto OSS inference stack.
- Portkey AI T2
AI gateway + observability — load balancing across 200+ LLMs, retries, caching, eval, prompts. Open-source Gateway + commercial Portkey Cloud. Acquired by Palo Alto Networks (closed about 2026-06); now sold as Prisma AIRS AI Gateway (GA 2026-07-16).
Sources (17 cited facts, 1 third-party)
Each fact links to the page it came from; the badge says who published it (how to read sources).
- What it is GPU cloud for AI vendor
- What it does & what's distinct GPU-cloud platform — Pods (long-running), Serverless (per-request), and Hub (community t… vendor
- Created 2022 vendor
- Latest release v1.12.0 (2026-08-10) — runpod (Python SDK) registry
- License proprietary; Python SDK MIT registry
- Funding $20M Series A 2024-05 (Intel Capital, Dell Technologies Capital led). vendor
- Pricing Pay-as-you-go per-second or per-hour GPU billing; e.g. H100 PCIe Pod $2.89/hr, H100 SXM … vendor
- Deployment Managed-only — GPU cloud (Pods, Serverless, Clusters) vendor
- HQ US vendor
- Founders / pedigree Zhen Lu (CEO), Pardeep Singh; founded 2022. vendor
- adoption-accelerator ai-grant third-party
- architecture-deployment-locus cloud vendor
- licensing-bucket commercial registry
- positioning-platform-vs-product platform vendor
- taxonomy-three-layer-rollup model-infra repo
- compliance-certifications gdpr,hipaa,iso27001,soc2-type2,soc3 vendor
- sdk-languages go,python,rest,typescript vendor
What changed
Changes to this record's lifecycle, licence, release, pricing and hosting facts, from the catalog's git history. Subscribe (Atom)
- 2026-10-27
- License first recorded as “proprietary; Python SDK MIT” source
- Latest release first recorded as “v1.12.0 (2026-08-10) — runpod (Python SDK)” source
- Pricing “Per-second GPU billing” → “Pay-as-you-go per-second or per-hour GPU billing; e.g. H100 PCIe Pod $2.89/hr, H100 SXM Pod $3.99/hr (Secure Cloud), Serverless H100 $4.79/hr; reserved capacity via sales” source
- Deployment first recorded as “Managed-only — GPU cloud (Pods, Serverless, Clusters)” source
Related systems
Referenced by (2)
- LangChain (framework) integrates with — LangChain's all-providers integrations page lists Runpod: "GPU cloud platform for AI workloads". (verified 2026-10-29)
- Vercel AI SDK integrates with — AI SDK docs have a Runpod community provider page. (verified 2026-10-29)