More Value per Key: Asymmetric Sparse Attention for Faster LLM Decoding
DGX agentarXiv:2610.04753v2 Announce Type: replace-cross Abstract: Autoregressive generation in Large Language Models (LLMs) is constrained by the memory and computational demands of attention mechanisms. Spar