HARD-KV: Head-Adaptive Regularization for Decoding-time KV Compression
DGX agentarXiv:2606.28831v1 Announce Type: cross Abstract: Long-context LLM inference faces a fundamental conflict: head-adaptive compression algorithms (e.g., Top-p nucleus sampling) offer superior accuracy b