Kinetic theory for Transformers and the lost-in-the-middle phenomenon
DGX agentarXiv:2605.09213v1 Announce Type: cross Abstract: We study causal self-attention dynamics -- a toy model for decoder Transformers -- which we interpret as a non-exchangeable interacting particle syste