Catalog Systems Recent method papers — theorized, no distinct product ReasoningBank

ReasoningBank

https://arxiv.org/abs/2509.25140

Scales agent self-evolution with reasoning memory.

At a glance

Type: Reasoning-memory self-evolution
Tier: T4
Section: Recent method papers — theorized, no distinct product
Created: 2025-09
Latest release: not applicable — not OSS
License: not applicable — not OSS
GitHub: not applicable — no GitHub repo
Pricing: not applicable — not commercial
Funding: not applicable — not commercial

Taxonomy

storage: vector
retrieval: similarity
persistence: long-term
update: extraction
unit: trajectory
governance: inspectable
conflict: llm-arbitrate

When to use

Optimised for: not applicable - research paper

Anti-fit: not applicable - research paper

Pros & cons

Pros

Bank of past reasoning trajectories for agent recall.

Cons

Preprint; trajectory storage scales with agent activity.

Claims & capabilities

Memory framework distilling generalizable reasoning strategies from agent self-judged successful and unsuccessful tasks; memory-aware test-time scaling (MaTTS) generates diverse experiences for higher-quality memory; consistent improvements across web browsing and software engineering benchmarks; emergent self-evolution from synergy with scaling; ICLR 2026

Technical surface

API surface: not applicable — research paper
Backend storage: not applicable — research paper
Deployment: not applicable — not a deployable product
Embedding model: not applicable — research paper
Multi-tenancy: not applicable — research paper
MCP: not applicable — research paper, no deployed product
A2A: not applicable — research paper, no deployed product
OpenTelemetry: not applicable — research paper, no deployed product

Similar systems

Other recent method papers — theorized, no distinct product in the catalog, ranked by inbound references.

Compressive Transformer T3
Maintains recent states in full resolution while compressing older memories with learned compression functions. DeepMind.
MemGPT v2 / agent-tools T3
Already in catalog as the foundational MemGPT paper. Note: Letta is the productionised successor (cross-listed).
Transformer-XL T3
Extends context through segment-level recurrence + caching of hidden states from prior segments. Foundational long-context architecture.
Generative Agents T3
Park et al. — landmark agent-simulation paper. Reflection + memory stream + retrieval enable believable agent behavior.
MemoryBank T3
Enhances LLMs with long-term memory. Early influential paper.
Reflexion T3
Language agents with verbal reinforcement learning.