Transformer Circuits Can Realize Clustering Algorithms
arXiv:2506.19125v2 Announce Type: replace-cross Abstract: Although transformers are most commonly optimized as statistical sequence models, it is unclear to what extent they can implement and learn ex