R2I

https://arxiv.org/abs/2403.04253

Memory-enhanced model-based RL agent built on DreamerV3. Modifies S4 to handle long temporal dependencies. Keeps DreamerV3's generality.

At a glance

Type
DreamerV3 + S4 long-range memory
Tier
T4
Created
2024-03
Latest release
no-release no-release
License
MIT
Pricing
not applicable — research paper
Funding
not applicable — not commercial

Taxonomy

storage
parametric
retrieval
parametric-recall
persistence
parametric-permanent
update
parametric-edit
unit
trajectory
governance
n/a
conflict
n/a

When to use

Optimised for: not applicable - research paper

Anti-fit: not applicable - research paper

Pros & cons

Pros

Recurrent retrieval for imagined-state planning.

Cons

Preprint; eval scope limited.

Claims & capabilities

Up to 9× faster than baselines.

Technical surface

API surface
not applicable — research paper
Backend storage
not applicable — research paper
Deployment
not applicable — research paper
Embedding model
not applicable — research paper
Multi-tenancy
not applicable — research paper
MCP
not applicable — research paper, no deployed product
A2A
not applicable — research paper, no deployed product
OpenTelemetry
not applicable — research paper, no deployed product

Similar systems

Other recent method papers — theorized, no distinct product in the catalog, ranked by inbound references.

  • Compressive Transformer T3

    Maintains recent states in full resolution while compressing older memories with learned compression functions. DeepMind.

  • MemGPT v2 / agent-tools T3

    Already in catalog as the foundational MemGPT paper. Note: Letta is the productionised successor (cross-listed).

  • Transformer-XL T3

    Extends context through segment-level recurrence + caching of hidden states from prior segments. Foundational long-context architecture.

  • Generative Agents T3

    Park et al. — landmark agent-simulation paper. Reflection + memory stream + retrieval enable believable agent behavior.

  • MemoryBank T3

    Enhances LLMs with long-term memory. Early influential paper.

  • Reflexion T3

    Language agents with verbal reinforcement learning.

Related systems

References (4)

  • Atari 100k cites — S2 isInfluential citation
  • DreamerV3 builds on — odel-based RL agent built on DreamerV3. Modifies S4 to handle long temporal dependencies. Keeps Dr
  • DreamerV3 cites — S2 isInfluential citation
  • Transformer-XL cites — S2 isInfluential citation

Row last verified 2026-05-14. Catalog data is CC-BY-4.0 — see how to read this.