SpectralShift: Effective Context Window Extension of Gated DeltaNet via Spectral Reparameterization
arXiv:2609.14320v1 Announce Type: new Abstract: Recently, linear attention layers have been increasingly adopted to replace softmax attention at scale for long-context modeling. However, existing cont