NVIDIA ReMEmbR
https://arxiv.org/abs/2409.13682
Builds long-horizon memory by captioning video segments with VILA, storing captions with timestamps + 3D position coordinates in MilvusDB. At query time, LLM iterates retrieval across text, time, and position modalities. Deployed on Nova Carter robot (Jetson Orin).
Active · Verified 2026-10-22 · fresh as of 2026-10-22 · 34 cited facts, 0 with a third-party source · Suggest a correction
At a glance
- Tier
- T3
- Latest release
- no releases fix
- GitHub
- NVIDIA-AI-IOT/remembr — ~359 stars, 13 commits repo fix
- Pricing
- searched not found fix
- Funding
- searched not found fix
- Freshness
- 2026-10-22 fix
- Layer
- agent-infra repo fix
- Licensing
- commercial repo fix
Memory taxonomy
- storage
- vector
- retrieval
- similarity
- persistence
- long-term
- update
- append-only
- unit
- episode
- governance
- inspectable
- conflict
- append
When to use
Optimised for: real-time perception + spatial reasoning + multi-modal sensor fusion
Anti-fit: not for non-embodied / non-physical use cases
Pros & cons
Pros
Episodic-memory robot reasoning framework — explicit memory of past attempts in a task.
Cons
NVIDIA-stack-tilted; research-stage.
Claims & capabilities
Outperforms LLM/VLM baselines on NaVQA across spatial, temporal, descriptive question types.
Technical surface
- API surface
- not applicable — research paper
- Backend storage
- not applicable — research paper
- Deployment
- Open-source (Custom NVIDIA license)
- Embedding model
- not applicable — research paper
- Multi-tenancy
- not applicable — research paper
- MCP
- not applicable — research paper, no deployed product
- A2A
- not applicable — research paper, no deployed product
- OpenTelemetry
- not applicable — research paper, no deployed product
Alternatives to NVIDIA ReMEmbR → live options ranked by shared design, licence, hosting and MCP support
Similar systems
Other vertical / domain-specific ai memory in the catalog, ranked by inbound references.
- Inworld AI T1
Formerly an NPC character engine with named Long-Term Memory; now sells realtime voice models (TTS-2, STT-1, speech-to-speech) and OpenAI-compatible open-model inference. Character/NPC memory is no longer the headline product.
- Abridge T1
Clinician-assist ambient documentation. Source mapping: every AI-generated summary element traced back to the source utterance. Audit-and-trust layer over episodic memory. Built on proprietary 1.5M+ medical-encounter dataset.
- ASAPP GenerativeAgent T1
Treats memory as first-class architecture. Captures the digital footprint of every interaction; retrieves preference and history at engagement time. Public example: airline knowing a frequent flyer wants aisle seats with her son — preference-aware, not just history-lookup.
- BenevolentAI T1
Taken private: merged into Osaka Holdings (renamed BenevolentAI S.A.) and delisted from Euronext Amsterdam 2025-03-13. Target identification / drug repurposing / mechanism tracing. 85+ data sources, petabyte-scale, rebuilt every few weeks. Wet-lab results re-enter the graph and shift downstream predictions — institutional experimental memory closing a feedback loop. As of Oct 2026 benevolent.com leads with Qor, powered by BenevolentAI, a life-science intelligence service for biopharma decision makers and consultancies. Qor (qor.one) is a continuously updated decision-intelligence service built on BenevolentAI's knowledge graph and reasoning methods: it tracks evidence on an asset or indication (competitive position, rival readouts, comparable deals), source-verifies each claim and flags when an earlier conclusion stops holding. It targets biotech teams and life-science consultancies.
- Causaly T1
Agentic AI platform for life sciences: orchestrated scientific agents over a curated biomedical knowledge graph (plus Bio Graph and Pipeline Graph), an evidence-retrieval system and an enterprise data fabric over literature, trials and patents.
- Character.ai T1
Chat Memories (user-defined facts), auto-memories for c.ai+ subscribers, pinned memories, in-context retention. Latest chat models PipSqueak 3 and ShortSqueak (Sep 2026). On 2026-10-12 the company announced a voluntary Chapter 11 process for a court-supervised sale of all or substantially all assets (sale expected late Nov/early Dec 2026); the platform keeps running meanwhile and would be wound down if no viable bid emerges.
Sources (33 cited facts, 0 third-party)
Each fact links to the page it came from; the badge says who published it (how to read sources).
- What it is Spatio-temporal episodic store (vector DB + coordinates) vendor
- What it does & what's distinct Builds long-horizon memory by captioning video segments with VILA, storing captions with… vendor
- Claims / benefits Outperforms LLM/VLM baselines on NaVQA across spatial, temporal, descriptive question ty… vendor
- Modalities vision + sensor + text vendor
- Created 2024-08 vendor
- License Custom repo
- GitHub NVIDIA-AI-IOT/remembr — ~359 stars, 13 commits repo
- Citations 63 cites 31/yr paper
- Deployment Open-source (Custom NVIDIA license) repo
- HQ US (NVIDIA Research) vendor
- Founders / pedigree NVIDIA Research; no individual authors confirmed vendor
- Memory volume / scale no scale claim (research; Nova Carter robot) vendor
- Performance ReMEmbR: long-horizon navigation Q&A — improved accuracy over zero-shot VLM baselines on… vendor
- Reproducibility No reproductions found vendor
- Code/weights release Code public + weights closed repo
- Versioning model-version semantics (policy checkpoints) vendor
- Namespace primitives robot-per-instance (per-robot memory) vendor
- Contradiction handling always append (no resolution) vendor
- Forgetting policy episode-based memory; long-term memory module retains landmarks; episodic memory pruned … vendor
- Validated verticals robotics (humanoid, manipulation), autonomous-driving, embodied AI research vendor
- Time to running weeks-to-months (custom robot/vehicle integration) or research-only code release vendor
- Anti-fit not for non-embodied / non-physical use cases vendor
- Optimised for real-time perception + spatial reasoning + multi-modal sensor fusion vendor
- Adjacent infrastructure requires robot / vehicle hardware + sensor stack vendor
- Pros Episodic-memory robot reasoning framework — explicit memory of past attempts in a task. vendor
- Cons NVIDIA-stack-tilted; research-stage. vendor
- Project & sources arxiv 2409.13682 GitHub vendor
- commit-trajectory [{"ym":"2024-09","cum":9},{"ym":"2024-10","cum":11},{"ym":"2025-03","cum":13}] repo
- citation-trajectory [{"year":2025,"cum":1,"infl":1}] paper
- architecture-deployment-locus local repo
- licensing-bucket commercial repo
- positioning-platform-vs-product platform repo
- taxonomy-three-layer-rollup agent-infra repo
Related systems
References (1)
- Milvus builds on — storing captions with timestamps + 3D position coordinates in MilvusDB
Referenced by (1)
- Meta-Memory cites — S2 isInfluential citation