Modern Transformers Are Implicit Hybrids: From Functional Differentiation to Principled Hybrid Architecture Design
DGX agentarXiv:2609.02986v1 Announce Type: new Abstract: Hybrid architectures combining Full Attention (FA) and Linear Attention (LA) are increasingly prominent, yet their allocation remains heuristic. We seek