Vortex: Efficient and Programmable Sparse Attention Serving for AI Agents
arXiv:2606.06453v1 Announce Type: new Abstract: Sparse attention is becoming increasingly important for serving large language models (LLMs) as generation lengths continue to grow. However, deploying