Atlas
https://arxiv.org/abs/2208.03299
Meta AI. Jointly fine-tunes retriever + LM for few-shot tasks.
At a glance
- Type
- Few-shot retrieval-augmented LM
- Tier
- T3
- Section
- Retrieval-as-memory hybrids
- Created
- 2022-11
- Latest release
- no-release no-release
- License
- CC-BY-NC 4.0
- GitHub
- 558★ Python
- Pricing
- searched not found
- Funding
- not applicable — not commercial
Taxonomy
- storage
- vector
- retrieval
- similarity
- persistence
- long-term
- update
- parametric-edit
- unit
- document
- governance
- inspectable
- conflict
- n/a
When to use
Optimised for: retrieval quality / accuracy on long-context QA
Anti-fit: most are research papers; production fitness varies by maintainer
Pros & cons
Pros
Meta retrieval architecture for few-shot learning.
Cons
Research scope; less production utility than fine-tuned RAG.
Claims & capabilities
Long-context architecture optimizing recall via test-time memory. Headline: +80% accuracy at 10M-token BABILong vs. Transformers and recent linear-recurrent baselines; baselines: Transformers and linear-recurrent models; primary dataset: BABILong (plus language modeling, common-sense reasoning, recall-intensive long-context tasks).
Technical surface
- API surface
- not applicable — research paper
- Backend storage
- not applicable — research paper
- Deployment
- searched not found
- Embedding model
- not applicable — research paper
- Multi-tenancy
- not applicable — research paper
- MCP
- not applicable — research paper, no deployed product
- A2A
- not applicable — research paper, no deployed product
- OpenTelemetry
- not applicable — research paper, no deployed product
Similar systems
Other retrieval-as-memory hybrids in the catalog, ranked by inbound references.
- GraphRAG (Microsoft) T1
Modular graph-based RAG. Leiden community detection over knowledge graph; community summaries at multiple levels. DRIFT Search hybrid (Oct 2024).
- RETRO T3
DeepMind. Retrieval-Enhanced Transformer with chunked cross-attention over a 2T-token retrieval database. Frozen BERT retriever + differentiable encoder.
- RAPTOR T3
Stanford recursive-summarisation tree over the corpus — clusters and summarises documents into a hierarchical index; retrieves at multiple levels. ICLR 2024.
- Self-RAG T4
Trains an LLM end-to-end to emit reflection tokens that decide whether to retrieve, assess passage relevance, and critique output quality — all within a single model.
- HippoRAG / HippoRAG2 T3
Hippocampus-inspired RAG. LLMs + knowledge graphs + Personalized PageRank to mimic neocortex/hippocampus roles. NeurIPS 2024.
- MemoRAG T4
RAG variant with a long-context global memory model that drafts answer clues used to guide passage retrieval — improves recall in noisy multi-hop QA.
Related systems
References (1)
- RETRO cites — S2 isInfluential citation
Referenced by (5)
- ITER-RETGEN cites — S2 isInfluential citation
- LongRAG cites — S2 isInfluential citation
- MemBART cites — S2 isInfluential citation
- Memformers (gradient memory) cites — S2 isInfluential citation
- Toolformer cites — S2 isInfluential citation