E8 Lattice Key Quantization for Low-Bit KV-Cache Compression
DGX agentarXiv:2610.15384v1 Announce Type: new Abstract: Compressing the key-value (KV) cache is essential for serving long-context large language models (LLMs) under memory constraints. While current scalar q