Energy-Gated Attention: Spectral Salience as an Inductive Bias for Transformer Attention
arXiv:2605.21842v1 Announce Type: cross Abstract: Standard transformer attention computes pairwise similarity between queries and keys, treating all tokens as equally salient regardless of their intri