Understanding Imbalanced Forgetting in Rehearsal-Based Class-Incremental Learning

arXiv:2605.14785v1 Announce Type: cross Abstract: Neural networks suffer from catastrophic forgetting in class-incremental learning (CIL) settings. Rehearsalnicode{x2013}replaying a subset of past samplesnicode{x2013}is a well-established mitigation strategy. However, recent results suggest that, despite balanced rehearsal allocation, some classes are forgotten substantially more than others. Despite its relevance, this imbalanced forgetting phenomenon remains underexplored. This work shows that imbalanced forgetting arises systematically and severely in rehearsal-based CIL and investigates it extensively. Specifically, we construct, from a principled analysis, three last-layer coefficients that capture different gradient-level sources of interference affecting each past class during an incremental step. We then demonstrate that, together, they reliably predict how past classes will rank in terms of forgetting at the end of that step. While predictive performance alone does not establish causality, these results support the interpretation of the coefficients as a plausible mechanistic account linking last-layer gradient-level interactions during training to class-level forgetting outcomes. Notably, one coefficientnicode{x2013}capturing self-induced interferencenicode{x2013}emerges as the strongest predictor, with controlled experiments providing evidence consistent with this coefficient being influenced by the new-class interference coefficient. Overall, our findings provide valuable insights and suggest promising directions for mitigating imbalanced forgetting by reducing class-wise disparities in the identified sources of interference.

Source: arXiv cs.CV | 2026-05-15