Sparse Attention as Compact Kernel Regression
DGX agentarXiv:2601.22766v3 Announce Type: replace Abstract: Recent work has revealed a link between self-attention mechanisms in transformers and test-time kernel regression via the Nadaraya-Watson estimator,