On-Policy Attention Linearization
DGX agentarXiv:2609.31947v1 Announce Type: new Abstract: Hybrid transformer architectures that replace most softmax attention layers with linear attention offer transformer-level quality at a fraction of the m
Knowledge catalogue
arXiv:2609.31947v1 Announce Type: new Abstract: Hybrid transformer architectures that replace most softmax attention layers with linear attention offer transformer-level quality at a fraction of the m
arXiv:2609.34806v1 Announce Type: cross Abstract: Reasoning about temporal structure of audio recordings requires Large Audio Language Models (LALMs) to associate sound events with their temporal posi