What can linear attention learn from nonlinear teachers in-context?
DGX agentarXiv:2610.10761v1 Announce Type: cross Abstract: Linear attention is a tractable model for understanding the mechanisms governing in-context learning in transformers. For linear regression tasks, rec