Catalog Systems Theoretical / informal — ideas without a paper Context Expansion Law

Context Expansion Law

https://huyenchip.com/2025/01/07/agents.html

"Application context tends to expand to fill the context limits supported by the model." Treats agent memory as a first-class unresolved design problem rather than a solved component; explicitly defers a memory deep-dive to a future post.

Active · Verified 2026-10-23 · fresh as of 2026-10-23 · 11 cited facts, 0 with a third-party source · Suggest a correction

At a glance

Type
Parkinson's-Law analogue for context vendor fix
Tier
T5
Section
Theoretical / informal — ideas without a paper
Created
searched not found fix
Latest release
not applicable — not OSS fix
License
not applicable — not OSS fix
GitHub
not applicable — no GitHub repo fix
Pricing
not applicable — not commercial fix
Funding
not applicable — not commercial fix
Freshness
2026-10-23 fix
Layer
agent-infra repo fix

Memory taxonomy

storage
none-trivial
retrieval
injection
persistence
ephemeral
update
n/a
unit
token
governance
n/a
conflict
out-of-scope

When to use

Optimised for: not applicable - theoretical / not a system

Anti-fit: not applicable - theoretical / not a system

Pros & cons

Pros

Treats agent memory as a first-class unresolved design problem rather than a solved component.

Cons

Blog post; states the problem clearly but defers the answer to a future post.

Claims & capabilities

Chip Huyen (author, AI Engineering O'Reilly 2025), Jan 2025 blog.

Technical surface

API surface
not applicable — theoretical / not a system
Backend storage
not applicable — theoretical / not a system
Deployment
not applicable — not a deployable product
Embedding model
not applicable — theoretical / not a system
Multi-tenancy
not applicable — theoretical / not a system
MCP
not applicable — theoretical / informal idea
A2A
not applicable — theoretical / informal idea
OpenTelemetry
not applicable — theoretical / informal idea

Similar systems

Other theoretical / informal — ideas without a paper in the catalog, ranked by inbound references.

  • From Human Memory to AI Memory (survey) T4

    Eight-quadrant classification grid across personal/system, parametric/non-parametric, and short-term/long-term axes. Bridges cognitive-science memory taxonomy to LLM architecture choices, less common than purely engineering-oriented surveys. v2 revision April 23, 2025.

  • Context Engineering T5

    "+1 for 'context engineering' over 'prompt engineering' … the delicate art and science of filling the context window with just the right information for the next step." The LLM is "a coworker with anterograde amnesia" — cannot consolidate or build long-running knowledge once training ends.

  • Context Engineering — naming event T5

    Endorses "context engineering" as a distinct discipline from prompt engineering — what agents do with their context window (routing, compression, tool output formatting, memory retrieval injection) is engineering, not just prompting.

  • Externalization in LLM Agents T4

    Traces the shift from weights-as-capability to harness-as-capability; analyzes memory, skills, and protocols as three coupled forms of externalization and examines how they interact. Memory is defined as the externalization of state across time. Covers self-evolving harnesses and shared agent infrastructure as emerging directions. April 9, 2026.

  • Files Are All You Need T5

    Coding agents (Claude Code, Cursor) converge on the filesystem as their primary memory abstraction: conversation histories as searchable files, skills as files, retrieval via file search rather than vector DBs. Argument: LLMs are fluent with filesystem concepts, so the filesystem is the right interface even if storage underneath is a database.

  • Four-Type Agent Memory Taxonomy T5

    "Agent = LLM + memory + planning + tools." Maps cognitive memory types to LLM machinery: sensory (learned embeddings), short-term / in-context (the context window), long-term (external vector store with fast retrieval). The first widely-cited taxonomy mapping human memory science onto LLM agent architecture.

Sources (10 cited facts, 0 third-party)

Each fact links to the page it came from; the badge says who published it (how to read sources).