Reflexion

Language agents with verbal reinforcement learning.

At a glance

Optimised for: not applicable - research paper

Anti-fit: not applicable - research paper

Defined verbal RL — agents reflect on failures and improve via memory of past attempts; widely cited.

Simulation-only; sample efficiency concerns; reflection quality bounded by underlying model.

Landmark. Defined "verbal RL" as a learning paradigm for LLM agents. Highly cited.

Other recent method papers — theorized, no distinct product in the catalog, ranked by inbound references.

Compressive Transformer T3
Maintains recent states in full resolution while compressing older memories with learned compression functions. DeepMind.
MemGPT v2 / agent-tools T3
Already in catalog as the foundational MemGPT paper. Note: Letta is the productionised successor (cross-listed).
Transformer-XL T3
Extends context through segment-level recurrence + caching of hidden states from prior segments. Foundational long-context architecture.
Generative Agents T3
Park et al. — landmark agent-simulation paper. Reflection + memory stream + retrieval enable believable agent behavior.
MemoryBank T3
Enhances LLMs with long-term memory. Early influential paper.
DreamerV3 T3
Hafner et al. General world-model agent. Symlog observation, KL balance, RMSNorm, Block GRU.