Poly-attention: a general scheme for higher-order self-attention
arXiv:2602.02422v2 Announce Type: replace Abstract: The self-attention mechanism, at the heart of the Transformer model, is able to effectively model pairwise interactions between tokens. However, num