Research
PLS in the Mirror of Self-Attention
arXiv:2605.28592v1 Announce Type: new Abstract: This note provides an interesting observation on casting partial least square (PLS) as a linearized self-attention so that PLS may be studied within the
arXiv:2605.28592v1 Announce Type: new Abstract: This note provides an interesting observation on casting partial least square (PLS) as a linearized self-attention so that PLS may be studied within the neural network paradigm. On the other hand, the dimensionality reduction and selection of predictors in PLS may indicate that self-attention includes certain degree of dimensionality normalization toward improved learning.
Source: arXiv cs.LG | 2026-05-28