Statistical Inference and Quality Measures of KV Cache Quantisations Inspired by TurboQuant
DGX agentarXiv:2605.08114v1 Announce Type: new Abstract: We analyse three KV cache quantization schemes under a fair bit budget: extbf{KV} (scalar MSE baseline), extbf{KQV} (WHT + MSE on K; WHT + MSE + QJL on