Memory Research & Benchmarks

264 systems · 2,542 edges · 264 visible · data as of 2026-10-31 (991 re-verified that month) · what changed

Papers, benchmarks and ideas behind agent memory, before they ship as products.

Click a row to inspect · shift-click rows (2-4) to compare · click headers to sort
System Tier Section What it is Created Citations Code/weights release Reproducibility Storage Retrieval License GitHub Verified
T1
Recent method papers — theorized, no distinct product
Conditional-memory N-gram lookup module ↗ 2
2026-01 ↗ 2
28 cites (28/yr) ↗ 2
Code public + demo code ↗ ●
Too recent — Jan 2026 preprint; no independent reproductions ↗ 2
parametric
parametric-recall
Apache-2.0 (code); Engram model use under a separate Model License ↗ ●
deepseek-ai/Engram — ~4.6k stars, 4 commits, last commit not confirmed ↗ ●
2026-10-23
T1
Recent method papers — theorized, no distinct product
Hybrid Mamba + sparse KV-cache, 1M-token context ↗ 2
2025-12 ↗ 2
Too recent — paper submitted December 24 2025; 69 citing models on HuggingFace noted; no S2 count confirmed ↗ 2
Code public + weights public (model weights on HuggingFace; training recipes at NVIDIA-NeMo/Nemotron) ↗ 2
Too recent (weights public; training recipes released at github.com/NVIDIA-NeMo/Nemotron) ↗ ●
kv-cacheparametric
attentioncache-lookup
·
·
2026-10-28
T2
Recent method papers — theorized, no distinct product
Mechanistic interpretability of parametric storage ↗ 2
2025-03-27 (published March 27 2025 on transformer-circuits.pub) ↗ 2
Too recent — published March 2025; not on arxiv; no S2 count available ↗ 2
Code public + weights closed (open-sourced circuit-tracing library; Neuronpedia frontend; no model weights released) ↗ 2
Original team only (Anthropic; open-source tools released June 2025; community replication pending) ↗ 2
parametric
parametric-recall
·
·
2026-10-28
T2
Memory benchmarks & evaluation
Anthropic agent demo — Claude 3.7/4 Sonnet plays Pokemon Red on Twitch ↗ 2
2025-02 (Anthropic livestream launch) ↗ 2
·
Source not released — Twitch livestream + Anthropic blog only ↗ 2
Twitch live-stream playthrough provides timestamped reproducibility evidence ↗ 2
kv
extraction-pull
·
·
2026-10-28
T2
Recent method papers — theorized, no distinct product
Lossless context compression via learned placeholders ↗ 2
2025-06 ↗ 2
Too recent — submitted Sep 2025; no S2 count confirmed ↗ 2
Paper only — no public code repo found ↗ 2
Too recent (ICML 2025 paper; no independent reproductions found) ↗ 2
parametrickv-cache
attentioncache-lookup
·
·
2026-10-28
T2
Memory benchmarks & evaluation
Workshop venue — RL + cognitive psychology + LLM memory ↗ 2
2026-04-27 (workshop held April 27 2026 at ICLR 2026 in Rio de Janeiro) ↗ 2
·
·
·
none-trivial
none
·
·
2026-10-23
T2
Recent method papers — theorized, no distinct product
Selective state-space model ↗ 2
2023-12 ↗ 2
searched not found ↗ 2
searched not found ↗ 2
searched not found ↗ 2
kv
similarity
searched not found ↗ 2
searched not found ↗ 2
2026-10-28
T2
Recent method papers — theorized, no distinct product
Fixed-size in-weights memory pool with online self-update ↗ 2
2024-02 ↗ 2
31 cites (15/yr); ICML 2024 ↗ 2
Active — last commit 2025-07 · 314★ ↗ ●
Independently reproduced (ICML 2024 published; community replications confirmed) ↗ ●
parametric
parametric-recallattention
·
·
2026-10-28
T2
Research / specialised systems
Verbatim chunks + spatial metaphor ↗ 2
2026-04 ↗ 2
searched not found ↗ 2
searched not found ↗ ●
searched not found ↗ ●
vector
similarity
MIT ↗ ●
51.3k★ +49.6k/mo Python ↗ ●
2026-10-28
T2
Recent method papers — theorized, no distinct product
Multi-agent collaborative framework ↗ 2
2023-08 ↗ 2
1698 cites (566/yr) ↗ 2
Active — last commit 2026-01 · 67,918★ ↗ ●
Independently reproduced (ICLR 2024 oral — top 1.2%) ↗ 2
filevector
similarityinjection
MIT ↗ ●
67.5k GitHub stars (FoundationAgents/MetaGPT) ↗ ●
2026-10-23
T2
Memory benchmarks & evaluation
Minecraft RL benchmark — obtain a diamond ↗ 2
2019 (Guss et al. IJCAI 2019) ↗ 2
500+ cites — MineRL paper + Diamond Challenge papers ↗ 2
Code public + Minecraft proprietary ↗ 2
Independently reproduced — DreamerV3 (DeepMind 2023), VPT (OpenAI 2022) ↗ 2
n/a
n/a
MIT ↗ 2
~700★ Python ↗ 2
2026-05-14
T2
Recent method papers — theorized, no distinct product
RAG context pruning + soft compression ↗ 2
2025-01 ↗ 2
searched not found ↗ 2
searched not found ↗ 2
Too recent ↗ 2
kv-cache
cache-lookupattention
·
·
2026-10-28
T2
Memory benchmarks & evaluation
Roguelike RL benchmark — NetHack as agent environment ↗ ●
2020-06 (Küttler et al. NeurIPS 2020) ↗ ●
200+ cites — NeurIPS 2020 paper ↗ ●
Code public + game-engine source open ↗ ●
Independently reproduced — community NetHack Challenge 2021 ↗ ●
n/a
n/a
NetHack General Public License ↗ ●
1.0k★ Python/C ↗ ●
2026-05-14
T2
Recent method papers — theorized, no distinct product
Per-neuron history + neural synchronization as latent ↗ 2
2025-05 ↗ 2
Too recent — submitted May 9 2025; no S2 count confirmed ↗ 2
Code public + weights public (SakanaAI/continuous-thought-machines GitHub; model checkpoints released) ↗ ●
Too recent (code public at SakanaAI/continuous-thought-machines with checkpoints) ↗ ●
parametric
parametric-recallattention
Apache-2.0 ↗ ●
1.8k★ Python ↗ ●
2026-10-23
T2
Recent method papers — theorized, no distinct product
KL-distillation experience internalization ↗ 2
2024-10 ↗ 2
Too recent — submitted Oct 2024; no S2 count confirmed ↗ 2
Active — last commit 2025-05 · 15★ ↗ ●
Too recent ↗ 2
parametric
parametric-recall
·
·
2026-10-28
T2
Recent method papers — theorized, no distinct product
Low-rank CPU-offloaded KV cache + sparse reconstruction ↗ 2
2024-10 ↗ 2
Too recent — ICML 2025 Spotlight (accepted 2024); no S2 count confirmed ↗ 2
Active — last commit 2025-05 · 297★ ↗ ●
Independently reproduced (ICML 2025 Spotlight acceptance implies community review) ↗ ●
kv-cache
cache-lookupattention
Apache-2.0 ↗ ●
297★ Python ↗ ●
2026-10-28
T3
Research / specialised systems
Atomic-note / Zettelkasten-style ↗ ●
2025-01 ↗ 2
443 cites 443/yr ↗ 2
Code public + weights closed ↗ ●
Too recent ↗ 2
graph
graph-traversalsimilarity
MIT ↗ ●
871★ +10/mo Python ↗ ●
2026-10-28
T3
Recent method papers — theorized, no distinct product
Paper ↗ 2
2025-11-16 ↗ ●
searched not found ↗ 2
searched not found ↗ 2
searched not found ↗ 2
file
injectionsimilarity
Apache-2.0 (official code) ↗ 2
https://github.com/ace-agent/ace (1387★) ↗ ●
2026-10-23
T3
Recent method papers — theorized, no distinct product
Workflow as memory ↗ 2
2024-09 ↗ 2
70 cites 35/yr ↗ 2
Code public + weights closed — https://github.com/zorazrw/agent-workflow-memory · 426* / 50 forks · last commit 2025-12 · Apache-2.0 ↗ ●
Independently reproduced: 50 forks of https://github.com/zorazrw/agent-workflow-memory; downstream papers cite results ↗ ●
file
injection
·
·
2026-10-23
T3
Memory benchmarks & evaluation
Benchmark ↗ ●
2023-07-28 ↗ ●
searched not found ↗ 2
searched not found ↗ ●
searched not found ↗ ●
n/a
n/a
Apache-2.0 ↗ ●
https://github.com/THUDM/AgentBench (3798★) ↗ ●
2026-10-29
T3
Recent method papers — theorized, no distinct product
Test-time plan-template memory ↗ 2
2025-06 ↗ 2
searched not found ↗ 2
depth-floor-reached: arXiv 2506.14852 preprint; no official code repo discovered via WebSearch + arXiv abstract scan + GitHub API ↗ 2
No reproductions found — published 2025-06-17 (11 mo ago); no public code ↗ 2
kv
similarity
·
·
2026-10-23
T3
Recent method papers — theorized, no distinct product
Hopfield + low-rank explicit memory ↗ 2
2023-09 ↗ 2
3 cites 1/yr ↗ 2
depth-floor-reached: arXiv 2309.12862 preprint; no official code repo discovered via WebSearch + arXiv abstract scan + GitHub API ↗ 2
depth-floor-reached: no reproductions found via Semantic Scholar / WebSearch / arXiv abstract scan ↗ 2
kv-cache
attentionsimilarity
·
·
2026-10-28
T3
Recent method papers — theorized, no distinct product
Null-space knowledge editing ↗ 2
2024-10 ↗ 2
191 cites 95/yr ↗ 2
Code public + weights closed — https://github.com/jianghoucheng/AlphaEdit · 439* / 46 forks · last commit 2025-10 · MIT ↗ ●
Highly reproduced: ICLR 2025 Outstanding Paper; downstream method AlphaEdit+ (ICLR 2026) builds directly on it; 191 cites (mostly downstream); 46 forks of official repo ↗ ●
parametric
parametric-recall
MIT ↗ ●
439★ Python ↗ ●
2026-10-28
T3
Memory benchmarks & evaluation
Mobile-OS agent benchmark — 116 real Android app tasks ↗ ●
2024-05 (Rawles et al. arXiv 2405.14573) ↗ ●
50+ cites — AndroidWorld paper (2024) ↗ ●
Code public ↗ ●
Independently reproduced — M3A, AppAgent-v2 evaluations ↗ ●
n/a
n/a
Apache-2.0 ↗ ●
1.2k★ Python ↗ ●
2026-10-28
T3
Recent method papers — theorized, no distinct product
CLS dual-layer episodic + semantic KG ↗ 2
2024-07 ↗ 2
63 cites 31/yr ↗ 2
Code public + weights closed — https://github.com/AIRI-Institute/AriGraph · stale (last commit 2024-09) · 166* / 28 forks · MIT ↗ ●
Original team only — 28 forks of https://github.com/AIRI-Institute/AriGraph (mostly fork-only; no public re-implementations identified via WebSearch) ↗ ●
graph
graph-traversalsimilarity
MIT ↗ ●
166★ Inform 7 ↗ ●
2026-10-28
T3
Memory benchmarks & evaluation
Sample-efficient RL benchmark — 100k env steps on Atari ↗ 2
2019-03 (Kaiser et al. SimPLe paper, ICLR 2020) ↗ 2
800+ cites — SimPLe paper (Kaiser et al.) introduced the 100k protocol ↗ 2
Code public (ALE / atari-py) ↗ 2
Independently reproduced — multiple SOTA papers reference the protocol ↗ 2
n/a
n/a
GPL-2.0 (ALE) ↗ 2
2.3k★ C++ (ALE / atari-py) ↗ 2
2026-10-28
T3
Memory benchmarks & evaluation
Distributed multi-fact reasoning across long docs ↗ 2
2024-02 ↗ 2
196 cites 98/yr ↗ 2
Code public + weights closed ↗ ●
Independently reproduced ↗ 2
n/a
n/a
Apache-2.0 ↗ ●
248★ Jupyter Notebook ↗ ●
2026-10-28
T3
Research / specialised systems
Hierarchical: short / mid / long-term ↗ ●
2025-05 ↗ ●
41 cites 41/yr ↗ 2
Code public + weights closed ↗ ●
Too recent ↗ 2
hybrid
similarityhybrid-rerank
Apache-2.0 ↗ ●
1.4k★ +40/mo Python ↗ ●
2026-10-28
T3
Memory benchmarks & evaluation
Benchmark ↗ 2
2025-10-28 ↗ ●
searched not found ↗ 2
searched not found ↗ 2
searched not found ↗ 2
none-trivial
none
MIT code; CC BY-SA 4.0 data ↗ 2
https://github.com/mohammadtavakoli78/BEAM (164★) ↗ ●
2026-10-23
T3
Memory benchmarks & evaluation
Benchmark ↗ 2
2023-05-19 ↗ ●
searched not found ↗ 2
searched not found ↗ 2
searched not found ↗ 2
n/a
n/a
Apache-2.0 ↗ 2
https://github.com/ShishirPatil/gorilla (13063★) ↗ ●
2026-10-29
T3
Memory benchmarks & evaluation
Benchmark ↗ 2
2024-04-11 ↗ ●
searched not found ↗ 2
searched not found ↗ 2
searched not found ↗ 2
n/a
n/a
MIT ↗ 2
https://github.com/openai/simple-evals (4686★) ↗ ●
2026-10-29
Buffer of Thoughts
T3
Recent method papers — theorized, no distinct product
Thought-augmented reasoning ↗ 2
2024-06-06 (arxiv 2406.04271 submitted June 6 2024; NeurIPS 2024 Spotlight) ↗ 2
7 cites 3/yr ↗ 2
Code public + weights closed — https://github.com/YangLing0818/buffer-of-thought-llm · 676* / 64 forks · last commit 2025-06 · MIT ↗ ●
Original team + downstream attention: 64 forks of https://github.com/YangLing0818/buffer-of-thought-llm; published 2024-06-06 (23 mo ago); no full re-implementations identified ↗ ●
kv
similarity
·
·
2026-10-23