Gradient Descent with Large Step Size Restores Symmetry in Deep Linear Networks with Multi-Pathway
DGX agentarXiv:2606.05219v1 Announce Type: cross Abstract: Recent analyses of multi-pathway Deep Linear Networks use Gradient Flow to predict a 'winner-takes-all' specialization in which path symmetry breaks a