ValueDiff: Value-Geometric KV Cache Eviction for Sink-Suppressed LLMs
arXiv:2609.23314v1 Announce Type: new Abstract: Modern LLMs with QK-normalization, gated attention, learned attention sinks, or logit softcapping exhibit weaker persistent attention sinks, on which ex