Quality Recovery for Quantized KV Caches via Low-Rank Attention Adaptation
DGX agentarXiv:2609.04263v1 Announce Type: cross Abstract: Low-bit key--value (KV) caches reduce the memory required for autoregressive decoding, but the resulting quality loss depends on the model and quantiz