TierKV: Long-Context On-Device LLMs via Predictive Multi-Tier KV Caching
DGX agentarXiv:2609.21172v1 Announce Type: new Abstract: Large language models (LLMs) are moving onto mobile devices for increasingly diverse workloads over text, images, video, and audio. These applications o