SAKI: Score-Aware Low-Rank Key Indexing for Long-Context KV Retrieval
DGX agentarXiv:2608.03228v1 Announce Type: new Abstract: Existing low rank KV cache methods preserve either model weights or key variance, neither of which directly reflects the attention scores used during in