Tensorion: A Tensor-Aware Generalization of the Muon Optimizer
arXiv:2606.25975v1 Announce Type: cross Abstract: Common first-order optimizers, such as Adam, implicitly treat each parameter block as an unstructured vector, which disregards the multilinear weight