OSCAR: Offline Spectral Covariance-Aware Rotation for 2-bit KV Cache Quantization
DGX agentarXiv:2605.17757v1 Announce Type: cross Abstract: INT2 KV-cache quantization is attractive for long-context LLM serving, but it remains difficult to make both accurate and deployable. Simple rotations