Catalog Systems Recent method papers — theorized, no distinct product LM2

LM2

Large memory models — explicit external memory module within transformer.

Active · Verified 2026-10-28 · fresh as of 2026-10-28 · 21 cited facts, 0 with a third-party source · Suggest a correction

At a glance

Type: Large memory models vendor fix
Tier: T4
Section: Recent method papers — theorized, no distinct product
Created: 2025-02 vendor fix
Latest release: not applicable — not OSS fix
License: not applicable — not OSS fix
GitHub: not applicable — no GitHub repo fix
Pricing: not applicable — not commercial fix
Funding: not applicable — not commercial fix
Freshness: 2026-10-28 fix
Layer: agent-infra repo fix

Memory taxonomy

storage: parametric
retrieval: attention
persistence: long-term
update: parametric-edit
unit: weight
governance: opaque
conflict: n/a

When to use

Optimised for: not applicable - research paper

Anti-fit: not applicable - research paper

Pros & cons

Pros

Language model with memory module — second-generation memory-augmented LM.

Cons

Preprint; module integration with frontier models unclear.

Claims & capabilities

Decoder-only Transformer with auxiliary memory module via cross-attention and gating; preserves general-purpose capabilities. Headline: +86.3% over Llama-3.2 average across BABILong; +37.1% over RMT; +5.0% on MMLU; baselines: vanilla Llama-3.2 and Recurrent Memory Transformer (RMT); primary datasets: BABILong (0K-128K tokens) and MMLU.

Technical surface

API surface: not applicable — research paper
Backend storage: not applicable — research paper
Deployment: not applicable — not a deployable product
Embedding model: not applicable — research paper
Multi-tenancy: not applicable — research paper
MCP: not applicable — research paper, no deployed product
A2A: not applicable — research paper, no deployed product
OpenTelemetry: not applicable — research paper, no deployed product

Similar systems

Other recent method papers — theorized, no distinct product in the catalog, ranked by inbound references.

Compressive Transformer T3
Maintains recent states in full resolution while compressing older memories with learned compression functions. DeepMind.
MemGPT v2 / agent-tools T3
Already in catalog as the foundational MemGPT paper. Note: Letta is the productionised successor (cross-listed).
Transformer-XL T3
Extends context through segment-level recurrence + caching of hidden states from prior segments. Foundational long-context architecture.
Generative Agents T3
Park et al. — landmark agent-simulation paper. Reflection + memory stream + retrieval enable believable agent behavior.
MemoryBank T3
Enhances LLMs with long-term memory. Early influential paper.
Reflexion T3
Language agents with verbal reinforcement learning.

Sources (20 cited facts, 0 third-party)

Each fact links to the page it came from; the badge says who published it (how to read sources).

What it is Large memory models vendor
What it does & what's distinct Large memory models — explicit external memory module within transformer. vendor
Claims / benefits Decoder-only Transformer with auxiliary memory module via cross-attention and gating; pr… vendor
Modalities text vendor
Created 2025-02 vendor
Mindshare 8 cites · 0.5/mo paper
Citations 8 cites 8/yr paper
Founders / pedigree Convergence Labs (UK; authors Jikun Kang, Wenqi Wu, Filippos Christianos, Alex J. Chan e… vendor
Memory volume / scale no scale claim — research vendor
Performance +86.3% BABILong avg vs Llama-3.2 +5.0% MMLU vendor
Reproducibility No reproductions found — published 2025-02-09 (15 mo ago); no public code vendor
Code/weights release depth-floor-reached: arXiv 2502.06049 preprint; no official code repo discovered via Web… vendor
Versioning snapshots vendor
Schema evolution schema locked vendor
Contradiction handling LLM resolves and overwrites vendor
Pros Language model with memory module — second-generation memory-augmented LM. vendor
Cons Preprint; module integration with frontier models unclear. vendor
Project & sources arxiv 2502.06049 vendor
citation-trajectory [{"year":2025,"cum":2,"infl":2}] paper
taxonomy-three-layer-rollup agent-infra repo

LM2