Karpathy proposes replacing on-the-fly retrieval with an LLM-maintained markdown wiki that ingests sources, compiles structured pages, and self-updates through ingest, query, and lint cycles. This approach builds a persistent, compounding knowledge base without vectors or re-retrieval, though it currently lacks enterprise controls.

• Karpathy's "LLM Wiki" replaces vector-based RAG with an LLM that reads sources once and maintains a persistent, self-updating markdown wiki instead of re-retrieving chunked fragments per query.
• The system runs three operations—ingest (add new material), query (answer from the wiki, then save new answers back into it), and lint (scheduled scans for outdated info, broken links, and gaps)—so every interaction compounds the knowledge base rather than starting fresh.
• It directly targets two RAG failure modes: stateless retrieval that repeats embedding work every query, and chunking that destroys document context.
• The idea echoes Vannevar Bush's 1945 Memex concept of an associative, hyperlinked personal knowledge library, though it currently lacks enterprise-grade controls.