TGV-KV: Text-Grounded KV Eviction for Vision-Language Models
DGX agentarXiv:2606.03075v1 Announce Type: new Abstract: Vision-Language Models (VLMs) inherit the auto-regressive generation paradigm and cache the keys and values (KV) of all previous tokens to accelerate in