ProxyKV: Cross-Model Proxy Pruning for Efficient Long-Context LLM Inference
DGX agentarXiv:2605.16360v1 Announce Type: cross Abstract: Efficient long-context inference in Large Language Models (LLMs) is severely constrained by the Key-Value (KV) cache memory wall, yet existing pruning