Unifying Sparse Attention with Hierarchical Memory for Scalable Long-Context LLM Serving
DGX agentarXiv:2604.26837v1 Announce Type: new Abstract: Long-context LLM serving is bottlenecked by the cost of attending over ever-growing KV caches. Dynamic sparse attention promises relief by accessing onl