Don't Forget! Decomposing the Training Dynamics of Memorization in Language Models
arXiv:2609.34933v1 Announce Type: new Abstract: Memorization has been proposed as a mechanism to explain how language models fit the tail of their training distributions, but its training dynamics are