Summary

Karpathy proposes a persistent markdown wiki maintained by an LLM as a stronger alternative to pure query-time retrieval. The raw sources remain immutable, while the wiki accumulates cross-linked summaries, comparisons, contradictions, and derived outputs.

Key points

• The wiki is a compiled artifact, not a passive file bucket.
• AGENTS.md or similar schema governs how the LLM maintains the wiki.
• index.md and log.md are enough to make small-to-medium systems navigable without heavy infrastructure.
• The main failure mode is epistemic drift.
• The best use cases are recurring, cumulative knowledge domains.

Implications

This is a strong fit for the domain of agentic development and local model operations because those topics change fast, require repeated comparison, and benefit from evolving judgments rather than one-shot summaries.

Open questions

• What should be mirrored locally as the first raw source set?
• How much review is required before a synthesis page is promoted from draft to active?

Sources

• https://gist.github.com/karpathy/442a6bf555914893e9891c11519de94f