Memformer
External key-value stores with similarity-based cache management; trained with Memory Replay Backpropagation.
Research code · Verified 2026-10-28 · fresh as of 2026-10-28 · 27 cited facts, 0 with a third-party source · 1 recorded change · Suggest a correction
At a glance
- Type
- External KV + Memory Replay Backprop repo fix
- Tier
- T3
- Latest release
- no-release no-release paper fix
- Pricing
- not applicable — research paper fix
- Funding
- not applicable — not commercial fix
- Freshness
- 2026-10-28 fix
- Layer
- agent-infra repo fix
- Licensing
- open-source repo fix
Memory taxonomy
- storage
- kv-cache
- retrieval
- attention
- persistence
- session
- update
- consolidation
- unit
- kv-token
- governance
- opaque
- conflict
- n/a
When to use
Optimised for: not applicable - research paper
Anti-fit: not applicable - research paper
Pros & cons
Pros
External KV stores with similarity-based cache management, trained with Memory Replay Backprop.
Cons
2020 paper — superseded in production by retrieval-augmented approaches.
Claims & capabilities
External dynamic memory transformer for sequence modeling; memory replay back-propagation (MRBP) for long-range BPTT. Headline: 8.1x less memory and 3.2x faster inference vs. standard Transformers with comparable performance; baseline: standard Transformers; primary dataset: not specified in abstract (long-sequence language modeling).
Technical surface
- API surface
- not applicable — research paper
- Backend storage
- not applicable — research paper
- Deployment
- not applicable — research paper
- Embedding model
- not applicable — research paper
- Multi-tenancy
- not applicable — research paper
- MCP
- not applicable — research paper, no deployed product
- A2A
- not applicable — research paper, no deployed product
- OpenTelemetry
- not applicable — research paper, no deployed product
Similar systems
Other recent method papers — theorized, no distinct product in the catalog, ranked by inbound references.
- Compressive Transformer T3
Maintains recent states in full resolution while compressing older memories with learned compression functions. DeepMind.
- MemGPT v2 / agent-tools T3
Already in catalog as the foundational MemGPT paper. Note: Letta is the productionised successor (cross-listed).
- Transformer-XL T3
Extends context through segment-level recurrence + caching of hidden states from prior segments. Foundational long-context architecture.
- Generative Agents T3
Park et al. — landmark agent-simulation paper. Reflection + memory stream + retrieval enable believable agent behavior.
- MemoryBank T3
Enhances LLMs with long-term memory. Early influential paper.
- Reflexion T3
Language agents with verbal reinforcement learning.
Sources (26 cited facts, 0 third-party)
Each fact links to the page it came from; the badge says who published it (how to read sources).
- What it is External KV + Memory Replay Backprop repo
- What it does & what's distinct External key-value stores with similarity-based cache management; trained with Memory Re… repo
- Claims / benefits External dynamic memory transformer for sequence modeling; memory replay back-propagatio… paper
- Modalities text paper
- Created 2022-12 paper
- Latest release no-release no-release paper
- License MIT repo
- GitHub 9★ Python repo
- Mindshare 77 cites · 1.2/mo · 126* / 10 forks · 6 influential SS cites paper
- Citations 77 cites 12/yr paper
- Founders / pedigree no data — no URL in landscape HTML; searched Memformer external KV memory replay paper
- Memory volume / scale no scale claim — research paper
- Performance 8.1x less memory 3.2x faster inference vs Transformer paper
- Reproducibility Original team only — 10 forks of https://github.com/lucidrains/memformer (mostly fork-on… repo
- Code/weights release Code public + weights closed — https://github.com/lucidrains/memformer · stale (last com… repo
- Consistency strong paper
- Versioning snapshots paper
- Schema evolution schema locked paper
- Forgetting policy consolidation/summarization paper
- Pros External KV stores with similarity-based cache management, trained with Memory Replay Ba… repo
- Cons 2020 paper — superseded in production by retrieval-augmented approaches. repo
- Project & sources arxiv 2010.06891 repo
- commit-trajectory [{"ym":"2022-12","cum":8},{"ym":"2023-03","cum":14},{"ym":"2023-06","cum":15}] repo
- citation-trajectory [{"year":2024,"cum":2,"infl":0},{"year":2025,"cum":6,"infl":2}] paper
- licensing-bucket open-source repo
- taxonomy-three-layer-rollup agent-infra repo
What changed
Changes to this record's lifecycle, licence, release, pricing and hosting facts, from the catalog's git history. Subscribe (Atom)
- 2026-10-22
- Lifecycle first recorded as “research-complete”
Related systems
References (1)
- Compressive Transformer cites — S2 isInfluential citation
Referenced by (2)
- MemBART cites — S2 isInfluential citation
- Memformers (gradient memory) cites — S2 isInfluential citation