Preserving Plasticity in Continual Learning via Dynamical Isometry
DGX agentarXiv:2606.09762v1 Announce Type: cross Abstract: Continual training of deep neural networks under non-stationarity often leads to a progressive loss of plasticity, eventually limiting further learnin