Asymptotic Signal Subspace Recovery in Softmax Attention Models
arXiv:2606.22406v1 Announce Type: new Abstract: Attention mechanisms have demonstrated remarkable empirical success in identifying relevant information from large collections of tokens, yet the theore