LOCKS: Page-Local Compact Key Summaries for Efficient Long-Context Decoding
arXiv:2607.24555v1 Announce Type: cross Abstract: Serving large language models at long context is bottlenecked by the key-value (KV) cache, which is read in full at every decode step. Attention keys