DAMP: Decay-Aware Mixed-Precision Recurrent-State Quantization
DGX agentarXiv:2608.27513v1 Announce Type: new Abstract: Softmax attention stores key and value vectors for every preceding token, causing inference memory to grow with sequence length. Recent language models