Neural Episodic Control

Pritzel et al. Agent stores past state-action-value tuples in a differentiable dictionary; recall via approximate nearest neighbour. ICML 2017.

At a glance

Optimised for: not applicable - research paper

Anti-fit: not applicable - research paper

DeepMind paper — defined episodic-memory-augmented RL; widely cited.

Small-scale benchmark scope; doesn't generalize to LLM agents directly.

Landmark. Established episodic-memory RL as a paradigm. Fast learning from sparse rewards.

Other recent method papers — theorized, no distinct product in the catalog, ranked by inbound references.

Compressive Transformer T3
Maintains recent states in full resolution while compressing older memories with learned compression functions. DeepMind.
MemGPT v2 / agent-tools T3
Already in catalog as the foundational MemGPT paper. Note: Letta is the productionised successor (cross-listed).
Transformer-XL T3
Extends context through segment-level recurrence + caching of hidden states from prior segments. Foundational long-context architecture.
Generative Agents T3
Park et al. — landmark agent-simulation paper. Reflection + memory stream + retrieval enable believable agent behavior.
MemoryBank T3
Enhances LLMs with long-term memory. Early influential paper.
Reflexion T3
Language agents with verbal reinforcement learning.