Backpropagated Output Momentum: Relocating Optimizer History from Parameters to Task Space
arXiv:2609.36738v1 Announce Type: cross Abstract: Optimizer momentum is usually stored as a parameter-sized moving average of past gradients, which makes history costly and fixes each past signal in t