Beyond RAG for Agent Memory
https://arxiv.org/abs/2602.02007
Argues standard RAG breaks on bounded agent conversation streams (highly correlated, redundant spans). Decomposes the stream into semantic units, organises them into themes, then inverts that structure for retrieval.
At a glance
- Type
- Decoupled-aggregate memory retrieval
- Tier
- T4
- Section
- Retrieval-as-memory hybrids
- Created
- 2026-02
- Latest release
- not applicable — not OSS
- License
- not applicable — not OSS
- GitHub
- not applicable — no GitHub repo
- Pricing
- not applicable — not commercial
- Funding
- not applicable — not commercial
Taxonomy
- storage
- hybrid
- retrieval
- similarity
- persistence
- long-term
- update
- read-only
- unit
- chunk
- governance
- inspectable
- conflict
- llm-arbitrate
When to use
Optimised for: retrieval quality / accuracy on long-context QA
Anti-fit: most are research papers; production fitness varies by maintainer
Pros & cons
Pros
Position paper arguing RAG is insufficient for agent memory.
Cons
Position paper; no concrete method.
Claims & capabilities
Consistent gains on LoCoMo and PerLTQA across diverse LLMs. Feb 2026.
Technical surface
- API surface
- not applicable — research paper
- Backend storage
- not applicable — research paper
- Deployment
- not applicable — not a deployable product
- Embedding model
- not applicable — research paper
- Multi-tenancy
- not applicable — research paper
- MCP
- not applicable — research paper, no deployed product
- A2A
- not applicable — research paper, no deployed product
- OpenTelemetry
- not applicable — research paper, no deployed product
Similar systems
Other retrieval-as-memory hybrids in the catalog, ranked by inbound references.
- GraphRAG (Microsoft) T1
Modular graph-based RAG. Leiden community detection over knowledge graph; community summaries at multiple levels. DRIFT Search hybrid (Oct 2024).
- RETRO T3
DeepMind. Retrieval-Enhanced Transformer with chunked cross-attention over a 2T-token retrieval database. Frozen BERT retriever + differentiable encoder.
- Atlas T3
Meta AI. Jointly fine-tunes retriever + LM for few-shot tasks.
- RAPTOR T3
Stanford recursive-summarisation tree over the corpus — clusters and summarises documents into a hierarchical index; retrieves at multiple levels. ICLR 2024.
- Self-RAG T4
Trains an LLM end-to-end to emit reflection tokens that decide whether to retrieve, assess passage relevance, and critique output quality — all within a single model.
- HippoRAG / HippoRAG2 T3
Hippocampus-inspired RAG. LLMs + knowledge graphs + Personalized PageRank to mimic neocortex/hippocampus roles. NeurIPS 2024.
Related systems
References (2)
- BAI-LAB MemoryOS cites — S2 isInfluential citation
- LightMem cites — S2 isInfluential citation