When Forgetting is not Catastrophic: On the Mechanics of Spurious Forgetting
arXiv:2610.08718v1 Announce Type: new Abstract: Knowledge that a language model appears to forget during finetuning often remains stored and can be recovered, a phenomenon called spurious forgetting.