Gating Enables Curvature: A Geometric Expressivity Gap in Attention
DGX agentarXiv:2604.14702v1 Announce Type: new Abstract: Multiplicative gating is widely used in neural architectures and has recently been applied to attention layers to improve performance and training stabi