Hierarchical Muon: Tiled Newton-Schulz Updates for Efficient Muon Optimization
arXiv:2606.27216v1 Announce Type: cross Abstract: Muon-type optimizers construct update directions for dense neural-network weights by applying a finite Newton-Schulz map to momentum-gradient matrices