Catalog Systems Recent method papers — theorized, no distinct product SELF-PARAM

SELF-PARAM

https://arxiv.org/abs/2410.00487

Encodes new experiences directly into the LLM's existing parameters by minimizing KL divergence between a teacher model (with context access) and a student model (without). Generates diverse QA pairs from new knowledge as the distillation signal. No new memory pool or external store added.

Active · Verified 2026-10-28 · fresh as of 2026-10-28 · 18 cited facts, 0 with a third-party source · Suggest a correction

At a glance

Type
KL-distillation experience internalization vendor fix
Tier
T2
Section
Recent method papers — theorized, no distinct product
Created
2024-10 vendor fix
Latest release
not applicable — not OSS fix
License
not applicable — not OSS fix
GitHub
not applicable — no GitHub repo fix
Pricing
not applicable — not commercial fix
Funding
not applicable — not commercial fix
Freshness
2026-10-28 fix
Layer
agent-infra repo fix

Memory taxonomy

storage
parametric
retrieval
parametric-recall
persistence
parametric-permanent
update
parametric-edit
unit
weight
governance
opaque
conflict
n/a

When to use

Optimised for: not applicable - research paper

Anti-fit: not applicable - research paper

Pros & cons

Pros

Zero-parameter overhead — no new layers, stores, or pools added; computationally accessible (fine-tuning only).

Cons

Internalization is a form of fine-tuning and risks catastrophic forgetting of earlier knowledge; updating is slow vs fast in-context or retrieval-based methods.

Claims & capabilities

Outperforms existing continual learning and memory injection methods on QA and conversational recommendation, even vs methods with nonzero storage cost.

Technical surface

API surface
searched not found
Backend storage
searched not found
Deployment
not applicable — not a deployable product
Embedding model
searched not found
Multi-tenancy
searched not found
MCP
not applicable — research paper, no deployed product
A2A
not applicable — research paper, no deployed product
OpenTelemetry
not applicable — research paper, no deployed product

Similar systems

Other recent method papers — theorized, no distinct product in the catalog, ranked by inbound references.

  • Compressive Transformer T3

    Maintains recent states in full resolution while compressing older memories with learned compression functions. DeepMind.

  • MemGPT v2 / agent-tools T3

    Already in catalog as the foundational MemGPT paper. Note: Letta is the productionised successor (cross-listed).

  • Transformer-XL T3

    Extends context through segment-level recurrence + caching of hidden states from prior segments. Foundational long-context architecture.

  • Generative Agents T3

    Park et al. — landmark agent-simulation paper. Reflection + memory stream + retrieval enable believable agent behavior.

  • MemoryBank T3

    Enhances LLMs with long-term memory. Early influential paper.

  • Reflexion T3

    Language agents with verbal reinforcement learning.

Sources (17 cited facts, 0 third-party)

Each fact links to the page it came from; the badge says who published it (how to read sources).