Quantifying Concentration Phenomena of Mean-Field Transformers in the Low-Temperature Regime
arXiv:2605.10931v1 Announce Type: cross Abstract: Transformers with self-attention modules as their core components have become an integral architecture in modern large language and foundation models.