What to Keep, What to Forget: A Rate--Distortion View of Memory Compaction in LLMs and Agents
DGX agentarXiv:2607.08032v1 Announce Type: new Abstract: Large language models, and the agents built on them, spend an ever-growing share of their compute and memory on remembering: caching attention keys and