A Self-Pruning Transformer: Extreme KV-Cache Compression with Universal Attention
arXiv:2610.09051v1 Announce Type: new Abstract: The large KV-cache size of modern LLMs creates a barrier to efficient deployment. Recent work has explored replacing attention layers' RoPE positional e