SG-Nav
https://arxiv.org/abs/2410.08189
Incrementally constructs hierarchical 3D scene graph during navigation — nodes for objects/groups/rooms, edges for spatial relations. Prunes stale nodes with linear complexity. Live graph passed as structured prompt to LLM that traverses with chain-of-thought.
At a glance
- Type
- Online 3D scene graph (incremental spatial memory)
- Tier
- T3
- Created
- 2024-10
- Latest release
- no releases
- License
- MIT
- GitHub
- 325★ Jupyter Notebook
- Pricing
- searched not found
- Funding
- no public funding — academic research
Taxonomy
- storage
- graph
- retrieval
- graph-traversal
- persistence
- session
- update
- append-only
- unit
- scene-graph
- governance
- inspectable
- conflict
- append
When to use
Optimised for: real-time perception + spatial reasoning + multi-modal sensor fusion
Anti-fit: not for non-embodied / non-physical use cases
Pros & cons
Pros
Scene-graph navigation — memory is a structured scene model rather than raw observation history.
Cons
Navigation scope; scene-graph build cost limits real-time use.
Claims & capabilities
First zero-shot method to beat supervised baselines on MP3D. >10% success-rate improvement over prior zero-shot SOTA on MP3D, HM3D, RoboTHOR. NeurIPS 2024.
Technical surface
- API surface
- not applicable — research paper
- Backend storage
- not applicable — research paper
- Deployment
- Open-source (MIT)
- Embedding model
- not applicable — research paper
- Multi-tenancy
- not applicable — research paper
- MCP
- not applicable — research paper, no deployed product
- A2A
- not applicable — research paper, no deployed product
- OpenTelemetry
- not applicable — research paper, no deployed product
Similar systems
Other vertical / domain-specific ai memory in the catalog, ranked by inbound references.
- NVIDIA ReMEmbR T3
Builds long-horizon memory by captioning video segments with VILA, storing captions with timestamps + 3D position coordinates in MilvusDB. At query time, LLM iterates retrieval across text, time, and position modalities. Deployed on Nova Carter robot (Jetson Orin).
- Abridge T1
Clinician-assist ambient documentation. Source mapping: every AI-generated summary element traced back to the source utterance. Audit-and-trust layer over episodic memory. Built on proprietary 1.5M+ medical-encounter dataset.
- ASAPP GenerativeAgent T1
Treats memory as first-class architecture. Captures the digital footprint of every interaction; retrieves preference and history at engagement time. Public example: airline knowing a frequent flyer wants aisle seats with her son — preference-aware, not just history-lookup.
- BenevolentAI T1
Target identification / drug repurposing / mechanism tracing. 85+ data sources, petabyte-scale, rebuilt every few weeks. Wet-lab results re-enter the graph and shift downstream predictions — institutional experimental memory closing a feedback loop.
- Causaly T1
Drug discovery / target identification / causal mechanism tracing. The graph is the memory: 7 years of curated biomedical cause-effect relationships compounding with each new ingestion. Scientific RAG retrieves from a versioned causal substrate.
- Character.ai T1
Chat Memories (user-defined facts), auto-memories for c.ai+ subscribers, pinned memories, in-context retention. PipSqueak 2 model (April 2026) reduces in-conversation drift. Memory Visualization meter forthcoming.