Beyond RAG for Agent Memory
https://arxiv.org/abs/2602.02007
Argues standard RAG breaks on bounded agent conversation streams (highly correlated, redundant spans). Decomposes the stream into semantic units, organises them into themes, then inverts that structure for retrieval.
Active · Verified 2026-10-22 · fresh as of 2026-10-22 · 24 cited facts, 0 with a third-party source · Suggest a correction
At a glance
- Type
- Decoupled-aggregate memory retrieval vendor fix
- Tier
- T4
- Section
- Retrieval-as-memory hybrids
- Latest release
- not applicable — not OSS fix
- License
- not applicable — not OSS fix
- GitHub
- not applicable — no GitHub repo fix
- Pricing
- not applicable — not commercial fix
- Funding
- not applicable — not commercial fix
- Freshness
- 2026-10-22 fix
- Layer
- agent-infra repo fix
- Licensing
- commercial vendor fix
Memory taxonomy
- storage
- hybrid
- retrieval
- similarity
- persistence
- long-term
- update
- read-only
- unit
- chunk
- governance
- inspectable
- conflict
- llm-arbitrate
When to use
Optimised for: retrieval quality / accuracy on long-context QA
Anti-fit: most are research papers; production fitness varies by maintainer
Pros & cons
Pros
Position paper arguing RAG is insufficient for agent memory.
Cons
Position paper; no concrete method.
Claims & capabilities
Consistent gains on LoCoMo and PerLTQA across diverse LLMs. Feb 2026.
Technical surface
- API surface
- not applicable — research paper
- Backend storage
- not applicable — research paper
- Deployment
- not applicable — not a deployable product
- Embedding model
- not applicable — research paper
- Multi-tenancy
- not applicable — research paper
- MCP
- not applicable — research paper, no deployed product
- A2A
- not applicable — research paper, no deployed product
- OpenTelemetry
- not applicable — research paper, no deployed product
Alternatives to Beyond RAG for Agent Memory → live options ranked by shared design, licence, hosting and MCP support
Similar systems
Other retrieval-as-memory hybrids in the catalog, ranked by inbound references.
- GraphRAG (Microsoft) T1
Modular graph-based RAG. Leiden community detection over knowledge graph; community summaries at multiple levels. DRIFT Search hybrid (Oct 2024). The GraphRAG repo is now largely in maintenance mode: no new features or PRs, only bug fixes and dependency/CVE updates.
- RETRO T3
DeepMind. Retrieval-Enhanced Transformer with chunked cross-attention over a 2T-token retrieval database. Frozen BERT retriever + differentiable encoder.
- Atlas T3
Meta AI. Jointly fine-tunes retriever + LM for few-shot tasks. The facebookresearch/atlas repo is no longer maintained; the code is provided as is.
- RAPTOR T3
Stanford recursive-summarisation tree over the corpus — clusters and summarises documents into a hierarchical index; retrieves at multiple levels. ICLR 2024.
- Self-RAG T4
Trains an LLM end-to-end to emit reflection tokens that decide whether to retrieve, assess passage relevance, and critique output quality — all within a single model.
- HippoRAG / HippoRAG2 T3
Hippocampus-inspired RAG. LLMs + knowledge graphs + Personalized PageRank to mimic neocortex/hippocampus roles. NeurIPS 2024.
Sources (23 cited facts, 0 third-party)
Each fact links to the page it came from; the badge says who published it (how to read sources).
- What it is Decoupled-aggregate memory retrieval vendor
- What it does & what's distinct Argues standard RAG breaks on bounded agent conversation streams (highly correlated, red… vendor
- Claims / benefits Consistent gains on LoCoMo and PerLTQA across diverse LLMs. Feb 2026. vendor
- Modalities text vendor
- Created 2026-02 vendor
- Citations 2 cites 2/yr paper
- Founders / pedigree no data — searched arxiv.org/abs/2602.02007; author affiliations not found in preview vendor
- Memory volume / scale no scale claim — research vendor
- Reproducibility Too recent vendor
- Versioning none vendor
- Contradiction handling LLM resolves and overwrites vendor
- Validated verticals research, RAG developers (horizontal); some have production deployments vendor
- Anti-fit most are research papers; production fitness varies by maintainer vendor
- Optimised for retrieval quality / accuracy on long-context QA vendor
- Adjacent infrastructure BYO LLM + vector store; OSS reference implementations exist vendor
- Pros Position paper arguing RAG is insufficient for agent memory. vendor
- Cons Position paper; no concrete method. vendor
- Project & sources arxiv 2602.02007 vendor
- citation-trajectory [] paper
- architecture-deployment-locus local repo
- licensing-bucket commercial vendor
- positioning-platform-vs-product platform repo
- taxonomy-three-layer-rollup agent-infra repo
Related systems
References (2)
- BAI-LAB MemoryOS cites — S2 isInfluential citation
- LightMem cites — S2 isInfluential citation