Orth-Dion: Eliminating Geometric Mismatch in Distributed Low-Rank Spectral Optimization
DGX agentarXiv:2605.16341v1 Announce Type: new Abstract: Low-rank gradient compression reduces communication in distributed training by representing updates with rank-r factors. Dion is a recent method that ap