LLMs are stateless (every time you reply to an LLM, you re-inject the entire conversation to a fresh inference) the purpose of memory is to …

LLMs are stateless (every time you reply to an LLM, you re-inject the entire conversation to a fresh inference) the purpose of memory is to provide continuity (in games we'd call it a 'persistent world') that optimizes the context so the LLM can efficiently answer questions about the world LLMs inverted a lot relative to software patterns: most software acted upon the world; with LLMs we have to construct the world around the LLM maybe the memory layer becomes the primary artifact (the persistent world), and LLMs become interchangeable reasoning engines plugged into it. the 'model' gets swapped out, but the agent's identity and history persist

Source: Yohei Nakajima (X) | 2026-05-20