Neural Attention Search Linear: Towards Adaptive Token-Level Hybrid Attention Models
DGX agentarXiv:2602.03681v2 Announce Type: replace Abstract: The quadratic computational complexity of softmax transformers has become a bottleneck in long-context scenarios. In contrast, linear attention mode