MM-ShiftKV: Decode-Aware Prefill-Stage KV Selection for Multimodal Large Language Models
DGX agentarXiv:2607.22586v1 Announce Type: new Abstract: Key-Value (KV) caching is essential for efficient inference in multimodal large language models (MLLMs), yet its memory footprint grows linearly with co