Catalog Systems Retrieval-as-memory hybrids CAG (Cache-Augmented Generation)

CAG (Cache-Augmented Generation)

https://arxiv.org/abs/2412.15605

"Don't Do RAG." Preloads all relevant documents into context, caches the resulting KV state; at inference the model answers from cache with no retrieval step — eliminates retrieval latency + retrieval-error failure modes.

Active · Verified 2026-10-22 · fresh as of 2026-10-22 · 30 cited facts, 2 with a third-party source · Suggest a correction

At a glance

Type
KV-cache preloading replaces retrieval vendor fix
Tier
T3
Section
Retrieval-as-memory hybrids
Created
2024-12 vendor fix
Latest release
no-release no-release vendor fix
License
MIT repo fix
GitHub
hhhuang/CAG — ~1.6k stars, last commit n/a repo fix
Pricing
searched not found fix
Funding
not applicable — not commercial fix
Freshness
2026-10-22 fix
Layer
agent-infra repo fix
Licensing
open-source repo fix
Deployment locus
local repo fix
Platform vs product
platform repo fix
Developer activity
OpenRank 1.01 (12-mo avg 2.22) · 2 participants — 2025-05 third-party fix
Maintainer health
0 issues in 90 days · 0 releases in 12 months · bus factor 2 — as of 2026-11-01 repo

Memory taxonomy

storage
kv-cache
retrieval
cache-lookup
persistence
session
update
read-only
unit
document
governance
inspectable
conflict
n/a

When to use

Optimised for: retrieval quality / accuracy on long-context QA

Anti-fit: most are research papers; production fitness varies by maintainer

Pros & cons

Pros

Prefill-cache reuse — when the corpus fits in context, retrieval can be replaced with cache lookup.

Cons

Requires the corpus to fit in context; doesn't scale to large knowledge bases.

Claims & capabilities

Matches or beats RAG accuracy on knowledge tasks while removing retrieval overhead. Best for bounded, static corpora. ACM Web Conf 2025.

Technical surface

API surface
not applicable — research paper
Backend storage
not applicable — research paper
Deployment
searched not found
Embedding model
not applicable — research paper
Multi-tenancy
not applicable — research paper
MCP
not applicable — research paper, no deployed product
A2A
not applicable — research paper, no deployed product
OpenTelemetry
not applicable — research paper, no deployed product

Alternatives to CAG (Cache-Augmented Generation) → live options ranked by shared design, licence, hosting and MCP support

Similar systems

Other retrieval-as-memory hybrids in the catalog, ranked by inbound references.

  • GraphRAG (Microsoft) T1

    Modular graph-based RAG. Leiden community detection over knowledge graph; community summaries at multiple levels. DRIFT Search hybrid (Oct 2024). The GraphRAG repo is now largely in maintenance mode: no new features or PRs, only bug fixes and dependency/CVE updates.

  • RETRO T3

    DeepMind. Retrieval-Enhanced Transformer with chunked cross-attention over a 2T-token retrieval database. Frozen BERT retriever + differentiable encoder.

  • Atlas T3

    Meta AI. Jointly fine-tunes retriever + LM for few-shot tasks. The facebookresearch/atlas repo is no longer maintained; the code is provided as is.

  • RAPTOR T3

    Stanford recursive-summarisation tree over the corpus — clusters and summarises documents into a hierarchical index; retrieves at multiple levels. ICLR 2024.

  • Self-RAG T4

    Trains an LLM end-to-end to emit reflection tokens that decide whether to retrieve, assess passage relevance, and critique output quality — all within a single model.

  • HippoRAG / HippoRAG2 T3

    Hippocampus-inspired RAG. LLMs + knowledge graphs + Personalized PageRank to mimic neocortex/hippocampus roles. NeurIPS 2024.

Sources (29 cited facts, 2 third-party)

Each fact links to the page it came from; the badge says who published it (how to read sources).

Related systems

References (1)

  • RULER cites — S2 isInfluential citation