Rank Collapse, Fixed Points, and the Renormalization Group Structure of MLP Residual Networks
DGX agentarXiv:2606.10324v1 Announce Type: new Abstract: The analogy between deep neural network forward passes and renormalization group (RG) flows has been repeatedly noted in the literature, but existing tr