Head-Aware Key-Value Compression for Efficient Autoregressive Image Generation
DGX agentarXiv:2605.20600v1 Announce Type: new Abstract: Autoregressive (AR) visual generation has achieved remarkable performance but suffers from high memory usage and low throughput, as it requires caching