CompactAttention: Accelerating Chunked Prefill with Block-Union KV Selection
DGX agentarXiv:2605.16839v1 Announce Type: new Abstract: Chunked prefill has become a widely adopted serving strategy for long-context large language models, but efficient attention computation in this regime