Spectral Geometry of Attention: From Information Routing to Uncertainty
DGX agentarXiv:2610.06012v1 Announce Type: new Abstract: In this work, we study transformer attention through the lens of spectral geometry and operator theory. We view each attention head as a functional map