Sakana CTM

https://arxiv.org/abs/2505.05522

Continuous Thought Machines. Each neuron maintains its own history of incoming activations via private per-neuron weight parameters; the model operates along a self-generated "thought step" timeline rather than the input sequence timeline. Neural synchronization across neurons is used directly as a latent representation. Distinct from Sakana NAMM (evolutionary attention memory) — CTM is an architectural rethink of the recurrent state itself.

Active · Verified 2026-10-23 · fresh as of 2026-10-23 · 22 cited facts, 1 with a third-party source · Suggest a correction

At a glance

Tier
T2
Created
2025-05 vendor fix
Latest release
no releases fix
License
Apache-2.0 repo fix
GitHub
1.8k★ Python repo fix
Pricing
not applicable — research paper fix
Funding
not applicable — not commercial fix
Freshness
2026-10-23 fix
Layer
agent-infra repo fix
Licensing
open-source repo fix

Memory taxonomy

storage
parametric
retrieval
parametric-recall
persistence
session
update
read-only
unit
kv-token
governance
opaque
conflict
n/a

When to use

Optimised for: not applicable - research paper

Anti-fit: not applicable - research paper

Pros & cons

Pros

Architecture-agnostic over data modality — can apply sequential "thought" to static inputs (images, graphs) that lack inherent sequence.

Cons

Research prototype; no production deployment; eval set is narrow and does not include long-document or multi-session memory tasks comparable to RAG or KV-cache work.

Claims & capabilities

Strong performance on ImageNet-1K, 2D maze solving, sorting, parity, QA, RL tasks without domain-specific tuning.

Technical surface

API surface
searched not found
Backend storage
searched not found
Deployment
not applicable — research paper
Embedding model
searched not found
Multi-tenancy
searched not found
MCP
not applicable — research paper, no deployed product
A2A
not applicable — research paper, no deployed product
OpenTelemetry
not applicable — research paper, no deployed product

Similar systems

Other recent method papers — theorized, no distinct product in the catalog, ranked by inbound references.

  • Compressive Transformer T3

    Maintains recent states in full resolution while compressing older memories with learned compression functions. DeepMind.

  • MemGPT v2 / agent-tools T3

    Already in catalog as the foundational MemGPT paper. Note: Letta is the productionised successor (cross-listed).

  • Transformer-XL T3

    Extends context through segment-level recurrence + caching of hidden states from prior segments. Foundational long-context architecture.

  • Generative Agents T3

    Park et al. — landmark agent-simulation paper. Reflection + memory stream + retrieval enable believable agent behavior.

  • MemoryBank T3

    Enhances LLMs with long-term memory. Early influential paper.

  • Reflexion T3

    Language agents with verbal reinforcement learning.

Sources (21 cited facts, 1 third-party)

Each fact links to the page it came from; the badge says who published it (how to read sources).