What Matters for Aggressive Decoding-Time KV Eviction? Temporal Aggregation and Ranking Preservation
DGX agentarXiv:2609.03515v1 Announce Type: new Abstract: Decoding-time KV cache compression research focuses heavily on designing better token scoring functions, while the temporal rule that aggregates scores