Dimensionless Controls of Plasticity Under Alternating Tasks: From Evolutionary Biology to Continual Learning

arXiv:2608.23889v1 Announce Type: cross Abstract: Plasticity under changing environments is central to both evolutionary biology and continual learning. Motivated by recent work on genotype--phenotype maps, we study a minimal deep-learning analogue where a network is trained alternately on two Boolean label sets, and ask which biological controls of plasticity survive the translation to gradient descent. Reinterpreting four proposed biological factors as quantities of training dynamics, we find the system reduces to two dimensionless controls: the task disagreement r, the fraction of disagreeing labels, and the reach eta T, the product of learning rate and switching period. We derive two bounds on plasticity: r alone fixes an extremal geometric floor on the utopia distance, while r and eta T jointly bound forgetting. Across 9,720 trajectories, an ANOVA confirms that r, eta, and T dominate, while the effect of neutral-set size (emphasized in the biological setting) is negligible. The optimal reach itself follows an approximate inverse power law eta T^{}propto r^{-1.18}, yielding a heuristic that sets the optimal reach eta T^ from the task disagreement alone. The analogy that survives is therefore dynamical rather than geometric, and our setting enables a view of plasticity through the lens of other driven systems in physics and engineering.

Related

• On the Theory of Continual Learning with Gradient Descent for Neural Networks
• From Order to Distribution: A Spectral Characterization of Forgetting in Continual Learning
• Dynamic gain neuromodulation attenuates the stability gap under joint training
• Optimal Alternating Regret for Online Learning and Games
• Predicting Plasticity in Deep Continual Learning: A Theoretical Perspective

Source: arXiv cs.LG | 2026-08-26