KV-Rescue: Recovering Reasoning Language Model KV Eviction Loss via Stepwise Interleaving
DGX agentarXiv:2608.15797v1 Announce Type: new Abstract: KV-cache eviction caps the memory cost of long reasoning traces but is inherently lossy because the model decodes from a partial view of its history. Un