RouteSparse: Input-Conditional Pattern Routing for Budgeted Long-Context Prefilling
arXiv:2608.29058v1 Announce Type: new Abstract: Dynamic sparse attention can reduce the quadratic cost of long-context prefilling without changing model weights. MInference assigns each attention head