FOGO: Forgetting-aware Orthogonalization Optimizer
DGX agentarXiv:2606.10406v1 Announce Type: cross Abstract: We argue that forgetting is not confined to continual learning but is a general optimization phenomenon: during standard training, dominant mini-batch