SketchSSM: Write to the Full State, Read from a Compact Sketch
arXiv:2609.33051v1 Announce Type: new Abstract: Hybrid-attention models replace most softmax attention layers with linear attention, reducing KV-cache growth and enabling larger decode batches where r