Faster Than Flash: Exploiting Attention Sparsity for Efficient Long-Context Decoding
DGX agentarXiv:2609.00097v1 Announce Type: cross Abstract: The development of long-context Large Language Models (LLMs) is constrained by the memory bandwidth bottleneck and quadratic complexity of the attenti