Trading Complexity for Expressivity Through Structured Generalized Linear Token Mixing
DGX agentarXiv:2605.31367v1 Announce Type: cross Abstract: Token mixing layers play a key role in how language models can learn and generate long-range dependencies. Their efficiency relies on the necessary tr