Do Deep Networks Forget Initialization? A Forgetting-Time View of Practical Inductive Bias
arXiv:2605.29152v1 Announce Type: new Abstract: Randomly initialized neural networks induce a prior over functions, but the predictor used in practice is produced only after training. We ask how much