From Rigid to Dynamic: Entropy-Guided Adaptive Inference for Long-Context LLMs
DGX agentarXiv:2606.09508v1 Announce Type: new Abstract: Existing sparse attention and KV cache compression methods for long-context LLM inference typically apply fixed sparsity patterns or uniform budgets acr