Comet ML
ML experiment tracking + LLM evaluation platform (Opik for LLM eval). Comet competes head-to-head with Weights & Biases.
Active · Verified 2026-10-27 · fresh as of 2026-10-27 · 22 cited facts, 4 with a third-party source · 1 recorded change · Suggest a correction
At a glance
- Type
- ML experiment tracking + LLM eval vendor fix
- Tier
- T2
- Section
- Training infrastructure
- Latest release
- v3.58.8 (2026-10-08) — comet-ml registry fix
- License
- proprietary; comet-ml SDK MIT; Opik Apache-2.0 repo fix
- GitHub
- comet-ml/opik — ~23.0k stars, last commit 2026-10 repo fix
- Pricing
- Opik: open source free, Free Cloud $0, Pro Cloud $19/mo, Enterprise custom; Experiment Management: Free, Pro $19/user/mo, Enterprise custom vendor fix
- Funding
- $108M total raised through Series B 2022-01 ($63M, OpenView led). third-party fix
- Freshness
- 2026-10-27 fix
- Layer
- model-infra repo fix
- Licensing
- commercial repo fix
- Accelerator
- techstars-2017 third-party fix
- Developer activity
- OpenRank 47.46 (12-mo avg 54.91) · 96 participants — 2026-09 third-party fix
When to use
Optimised for: searched not found
Anti-fit: searched not found
Pros & cons
Pros
searched not found
Cons
searched not found
Claims & capabilities
$50M Series B 2021 (OpenView led).
Technical surface
- API surface
- Python SDK, TypeScript SDK, REST API, OpenTelemetry ingestion
- Backend storage
- searched not found
- Deployment
- Both (self-hosted + managed cloud) — Comet cloud; Opik self-hosted via Docker Compose/Helm; on-prem on Enterprise
- Embedding model
- not applicable — not a memory product
- Multi-tenancy
- searched not found
- MCP
- yes — opik-mcp MCP server for Claude Code, Cursor, VS Code
- A2A
- searched not found
- OpenTelemetry
- searched not found
Similar systems
Other training infrastructure in the catalog, ranked by inbound references.
- MLflow T1
Databricks-incubated open platform for ML lifecycle — tracking, projects, models, model registry. Standard ML-ops baseline. MLflow 3.0 (2024) added LLM-eval features.
- AWS SageMaker T1
AWS's managed ML platform — Studio, Training, HyperPod (large-scale clusters), Endpoints. Industry-standard for enterprise AWS-hosted training.
- Weights & Biases T1
Experiment-tracking and ML-ops platform (metrics, artifacts, sweeps, Weave tracing/evals). Acquired by CoreWeave (completed 2025-05-05, ~$1.7B); now part of CoreWeave Forge.
- Azure Machine Learning T1
Microsoft Azure's managed ML platform — pipelines, AutoML, Designer, prompt flow (LLM). Heavy integration with Azure OpenAI and Azure AI Studio.
- LoRA T3
Microsoft Research's Low-Rank Adapters method — trains rank-r matrices added to attention weights; 10000x parameter reduction. Foundation of all adapter-style fine-tuning.
- Argilla T2
Open-source data-quality platform for LLM training data — human-in-the-loop labelling, RLHF data collection, dataset curation. Acquired by Hugging Face 2024.
Sources (21 cited facts, 4 third-party)
Each fact links to the page it came from; the badge says who published it (how to read sources).
- What it is ML experiment tracking + LLM eval vendor
- What it does & what's distinct ML experiment tracking + LLM evaluation platform (Opik for LLM eval). Comet competes hea… vendor
- Claims / benefits $50M Series B 2021 (OpenView led). vendor
- Created 2017 vendor
- Latest release v3.58.8 (2026-10-08) — comet-ml registry
- License proprietary; comet-ml SDK MIT; Opik Apache-2.0 repo
- GitHub comet-ml/opik — ~23.0k stars, last commit 2026-10 repo
- Funding $108M total raised through Series B 2022-01 ($63M, OpenView led). third-party
- Customers / scale Uber, Etsy, Affirm, Zappos, Ancestry, Allianz; commercial MLOps experiment tracking. vendor
- Pricing Opik: open source free, Free Cloud $0, Pro Cloud $19/mo, Enterprise custom; Experiment M… vendor
- Deployment Both (self-hosted + managed cloud) — Comet cloud; Opik self-hosted via Docker Compose/He… vendor
- HQ New York, NY, USA. third-party
- Founders / pedigree Gideon Mendels (CEO), Niko Laskaris; founded 2017. vendor
- API surface Python SDK, TypeScript SDK, REST API, OpenTelemetry ingestion repo
- MCP support yes — opik-mcp MCP server for Claude Code, Cursor, VS Code repo
- adoption-accelerator techstars-2017 third-party
- architecture-deployment-locus hybrid vendor
- licensing-bucket commercial repo
- positioning-platform-vs-product platform vendor
- taxonomy-three-layer-rollup model-infra repo
- developer-activity-opendigger {"activity":531.69,"as_of":"2026-09","openrank_12mo":54.91,"openrank_current":47.46,"par… third-party
What changed
Changes to this record's lifecycle, licence, release, pricing and hosting facts, from the catalog's git history. Subscribe (Atom)
- 2026-10-27
- License first recorded as “proprietary; comet-ml SDK MIT; Opik Apache-2.0” source
- Latest release first recorded as “v3.58.8 (2026-10-08) — comet-ml” source
- Pricing first recorded as “Opik: open source free, Free Cloud $0, Pro Cloud $19/mo, Enterprise custom; Experiment Management: Free, Pro $19/user/mo, Enterprise custom” source
- Deployment first recorded as “Both (self-hosted + managed cloud) — Comet cloud; Opik self-hosted via Docker Compose/Helm; on-prem on Enterprise” source
- MCP support first recorded as “yes — opik-mcp MCP server for Claude Code, Cursor, VS Code” source
Related systems
References (46)
- Anthropic Claude (foundation models) integrates with — Comet's Opik docs have a Anthropic Claude (foundation models) integration page. (verified 2026-10-29)
- AutoGen / AG2 integrates with — Comet's Opik docs have a AutoGen / AG2 integration page. (verified 2026-10-29)
- BeeAI Framework integrates with — Comet's Opik docs have a BeeAI Framework integration page. (verified 2026-10-29)
- Claude Agent SDK integrates with — Comet's Opik docs have a Claude Agent SDK integration page. (verified 2026-10-29)
- Claude Code (Anthropic) integrates with — Comet's Opik docs have a Claude Code (Anthropic) integration page. (verified 2026-10-29)
- Cohere Command R+ / Command A integrates with — Comet's Opik docs have a Cohere Command R+ / Command A integration page. (verified 2026-10-29)
- CrewAI integrates with — Comet's Opik docs have a CrewAI integration page. (verified 2026-10-29)
- Cursor (IDE) integrates with — Comet's Opik docs have a Cursor (IDE) integration page. (verified 2026-10-29)
- DeepSeek R1 / V3 family integrates with — Comet's Opik docs have a DeepSeek R1 / V3 family integration page. (verified 2026-10-29)
- Dify integrates with — Comet's Opik docs have a Dify integration page. (verified 2026-10-29)
- DSPy integrates with — Comet's Opik docs have a DSPy integration page. (verified 2026-10-29)
- Fireworks AI integrates with — Comet's Opik docs have a Fireworks AI integration page. (verified 2026-10-29)
- Flowise Memory integrates with — Comet's Opik docs have a Flowise Memory integration page. (verified 2026-10-29)
- GitHub Copilot (Agent Mode) integrates with — Comet's Opik docs have a GitHub Copilot (Agent Mode) integration page. (verified 2026-10-29)
- Google Agent Development Kit (ADK) integrates with — Comet's Opik docs have a Google Agent Development Kit (ADK) integration page. (verified 2026-10-29)
- Google Gemini 3 family integrates with — Comet's Opik docs have a Google Gemini 3 family integration page. (verified 2026-10-29)
- Haystack (framework) integrates with — Comet's Opik docs have a Haystack (framework) integration page. (verified 2026-10-29)
- Helicone integrates with — Comet's Opik docs have a Helicone integration page. (verified 2026-10-29)
- Hugging Face Datasets integrates with — Comet's Opik docs have a Hugging Face Datasets integration page. (verified 2026-10-29)
- LangChain (framework) integrates with — Comet's Opik docs have a LangChain (framework) integration page. (verified 2026-10-29)
- Langflow integrates with — Comet's Opik docs have a Langflow integration page. (verified 2026-10-29)
- LangGraph (orchestration) integrates with — Comet's Opik docs have a LangGraph (orchestration) integration page. (verified 2026-10-29)
- LiteLLM integrates with — Comet's Opik docs have a LiteLLM integration page. (verified 2026-10-29)
- LiveKit Agents integrates with — Comet's Opik docs have a LiveKit Agents integration page. (verified 2026-10-29)
- LlamaIndex (framework) integrates with — Comet's Opik docs have a LlamaIndex (framework) integration page. (verified 2026-10-29)
- Mastra integrates with — Comet's Opik docs have a Mastra integration page. (verified 2026-10-29)
- Microsoft Agent Framework integrates with — Comet's Opik docs have a Microsoft Agent Framework integration page. (verified 2026-10-29)
- Microsoft Semantic Kernel integrates with — Comet's Opik docs have a Microsoft Semantic Kernel integration page. (verified 2026-10-29)
- Mistral Large 2 / Mixtral family integrates with — Comet's Opik docs have a Mistral Large 2 / Mixtral family integration page. (verified 2026-10-29)
- n8n (AI agent flows) integrates with — Comet's Opik docs have a n8n (AI agent flows) integration page. (verified 2026-10-29)
- OpenAI Agents SDK integrates with — Comet's Opik docs have a OpenAI Agents SDK integration page. (verified 2026-10-29)
- OpenAI Codex CLI integrates with — Comet's Opik docs have a OpenAI Codex CLI integration page. (verified 2026-10-29)
- OpenAI GPT family (GPT-5 / GPT-4o / o3 / o4) integrates with — Comet's Opik docs have a OpenAI GPT family (GPT-5 / GPT-4o / o3 / o4) integration page. (verified 2026-10-29)
- OpenRouter integrates with — Comet's Opik docs have a OpenRouter integration page. (verified 2026-10-29)
- Phidata (now Agno) integrates with — Comet's Opik docs have a Phidata integration page. (verified 2026-10-29)
- Pipecat (Daily) integrates with — Comet's Opik docs have a Pipecat (Daily) integration page. (verified 2026-10-29)
- Portkey AI integrates with — Comet's Opik docs have a Portkey AI integration page. (verified 2026-10-29)
- Pydantic-AI integrates with — Comet's Opik docs have a Pydantic-AI integration page. (verified 2026-10-29)
- Ragas integrates with — Comet's Opik docs have a Ragas integration page. (verified 2026-10-29)
- smolagents (Hugging Face) integrates with — Comet's Opik docs have a smolagents (Hugging Face) integration page. (verified 2026-10-29)
- Spring AI ChatMemory integrates with — Comet's Opik docs have a Spring AI ChatMemory integration page. (verified 2026-10-29)
- Strands Agents (AWS) integrates with — Comet's Opik docs have a Strands Agents (AWS) integration page. (verified 2026-10-29)
- Temporal integrates with — Comet's Opik docs have a Temporal integration page. (verified 2026-10-29)
- Together AI integrates with — Comet's Opik docs have a Together AI integration page. (verified 2026-10-29)
- Vercel AI SDK integrates with — Comet's Opik docs have a Vercel AI SDK integration page. (verified 2026-10-29)
- xAI Grok 4 integrates with — Comet's Opik docs have a xAI Grok 4 integration page. (verified 2026-10-29)
Referenced by (11)
- CrewAI integrates with — CrewAI docs have an Opik (Comet) observability integration page. (verified 2026-10-29)
- Dify integrates with — Dify monitoring integration: "Integrate with Opik" (tracing). (verified 2026-10-29)
- Haystack (framework) integrates with — Haystack integrations directory has an Opik integration page ("Trace and evaluate your Haystack pipelines with Opik"). (verified 2026-10-29)
- Langflow integrates with — Langflow integration page: Opik tracing. (verified 2026-10-29)
- LiteLLM integrates with — LiteLLM docs have a Comet Opik logging/observability integration page. (verified 2026-10-29)
- LlamaIndex (framework) integrates with — LlamaIndex has an official callback/observability integration package llama-index-callbacks-opik in its repo. (verified 2026-10-29)
- OpenAI Agents SDK integrates with — OpenAI Agents SDK tracing docs list Comet Opik under external tracing processors. (verified 2026-10-29)
- OpenRouter integrates with — OpenRouter Broadcast docs have a page for sending request traces to Comet Opik. (verified 2026-10-29)
- Strands Agents (AWS) integrates with — Strands Agents traces docs list Opik (Comet) as a visualization option for its OpenTelemetry traces. (verified 2026-10-29)
- TrueFoundry AI Gateway integrates with — TrueFoundry AI Gateway ecosystem lists a Comet Opik integration page. (verified 2026-10-29)
- Weaviate integrates with — Weaviate's integrations / model-provider docs list Comet ML as an integration. (verified 2026-10-29)