Data Mixing Can Induce Phase Transitions in Knowledge Acquisition
DGX agentarXiv:2505.18091v3 Announce Type: replace-cross Abstract: Large Language Models (LLMs) are typically trained on data mixtures: most data come from web scrapes, while a small portion is curated from hi