M3-Agent (ByteDance)
https://github.com/ByteDance-Seed/m3-agent
ByteDance Seed + Zhejiang Univ + SJTU. Multimodal agent with long-term memory as entity-centric graph built from live video + audio streams. Parallel memorisation + control processes. Ships M3-Bench evaluation dataset.
Active · Verified 2026-10-22 · fresh as of 2026-10-22 · 37 cited facts, 2 with a third-party source · Suggest a correction
At a glance
- Tier
- T2
- Section
- Dedicated memory layers
- Latest release
- no releases fix
- License
- Apache-2.0 repo fix
- Funding
- not applicable — ByteDance corporate research repo fix
- Freshness
- 2026-10-22 fix
- Layer
- agent-infra repo fix
- Licensing
- open-source repo fix
- Developer activity
- OpenRank 1.05 (12-mo avg 1.58) · 1 participants — 2025-12 third-party fix
Memory taxonomy
- storage
- graph
- retrieval
- graph-traversal
- persistence
- long-term
- update
- extraction
- unit
- episode
- governance
- opaque
- conflict
- n/a
When to use
Optimised for: episodic + semantic multimodal memory graph (research)
Anti-fit: not applicable - research paper
Pros & cons
Pros
Multi-modal multi-memory agent — three coordinated memory streams for video, audio, text agent tasks.
Cons
ByteDance-internal; published architecture but production access limited; eval primarily on Chinese benchmarks.
Claims & capabilities
+6.7% / +7.7% / +5.3% accuracy on M3-Bench-robot / M3-Bench-web / VideoMME-long vs Gemini-1.5-pro + GPT-4o baseline.
Technical surface
- API surface
- searched not found
- Backend storage
- searched not found
- Deployment
- Self-hosted (research code; API config + memory graph files)
- Embedding model
- searched not found
- Multi-tenancy
- searched not found
- MCP
- not documented publicly
- A2A
- not documented publicly
- OpenTelemetry
- not documented publicly
Alternatives to M3-Agent (ByteDance) → live options ranked by shared design, licence, hosting and MCP support
Similar systems
Other dedicated memory layers in the catalog, ranked by inbound references.
- Mem0 T1
Universal memory layer for AI agents. Three concurrent stores (vector + graph + KV); LLM-extracted facts; concurrent retrieval via ThreadPoolExecutor.
- Zep & Graphiti T1
Bi-temporal knowledge graph (event time + ingestion time). Strong on chronological reasoning and contradiction tracking. Graphiti is the open-source core.
- Cognee T1
"Extract–Cognify–Load" pipeline that turns raw input into a typed, queryable knowledge graph for agent recall.
- Hindsight (Vectorize) T1
Standalone memory service from Vectorize. Open source. Biomimetic four-network design (World, Bank, Observation, Opinion). Ships an MCP memory server.
- Letta / MemGPT T1
Originated as MemGPT (UC Berkeley), where the model pages its own memory between context, recall and archival tiers. The product now centres on Letta Code, a stateful agent harness whose agents rewrite their own memory, skills and prompts over time.
- Memori T2
Structured, persistent memory layer for AI agents. Open source.
Sources (36 cited facts, 2 third-party)
Each fact links to the page it came from; the badge says who published it (how to read sources).
- What it is Episodic + semantic multimodal memory graph repo
- What it does & what's distinct ByteDance Seed + Zhejiang Univ + SJTU. Multimodal agent with long-term memory as entity-… repo
- Claims / benefits +6.7% / +7.7% / +5.3% accuracy on M3-Bench-robot / M3-Bench-web / VideoMME-long vs Gemin… repo
- Modalities text + video + audio (builds memory from live video and audio streams) third-party
- Created 2025-07 repo
- License Apache-2.0 repo
- GitHub ByteDance-Seed/m3-agent — ~1.4k stars, last commit not confirmed repo
- Mindshare 1.3k GitHub stars; below detection threshold; ~5 cites on arXiv:2508.09736 (paper too re… repo
- Citations Too recent — paper submitted Aug 2025; ~5 cites est paper
- Funding not applicable — ByteDance corporate research repo
- Customers / scale not applicable — corporate research product repo
- Pricing not applicable — academic research code (no commercial pricing) repo
- Deployment Self-hosted (research code; API config + memory graph files) repo
- HQ China (ByteDance — Beijing HQ) repo
- Founders / pedigree ByteDance Research (Seed team); corporate research; no individual founders repo
- Reproducibility Too recent paper
- Code/weights release Code public + weights public (Hugging Face: ByteDance-Seed/M3-Agent-Memorization and M3-… repo
- Schema evolution schema with migration repo
- Namespace primitives per-tenant repo
- Contradiction handling LLM resolves and overwrites repo
- Integration count 0 repo
- Orchestration single-agent repo
- Programmatic control research code (PyTorch training + inference scripts; no production API) repo
- Vendor benchmarks +6.7%/+7.7%/+5.3% on M3-Bench-robot/web/VideoMME-long vs Gemini-1.5-pro+GPT-4o (vendor) repo
- Validated verticals research only repo
- Optimised for episodic + semantic multimodal memory graph (research) repo
- Pros Multi-modal multi-memory agent — three coordinated memory streams for video, audio, text… repo
- Cons ByteDance-internal; published architecture but production access limited; eval primarily… repo
- Project & sources GitHub arxiv 2508.09736 repo
- commit-trajectory [{"ym":"2025-08","cum":8},{"ym":"2025-09","cum":12},{"ym":"2025-10","cum":14},{"ym":"202… repo
- architecture-deployment-locus local repo
- licensing-bucket open-source repo
- positioning-platform-vs-product platform repo
- taxonomy-three-layer-rollup agent-infra repo
- developer-activity-opendigger {"activity":2.34,"as_of":"2025-12","openrank_12mo":1.58,"openrank_current":1.05,"partici… third-party
- sdk-languages python repo