GEM: Geometric Entropy Mixing for Optimal LLM Data Curation
DGX agentarXiv:2605.26121v1 Announce Type: cross Abstract: LLM pre-training efficacy increasingly depends on data composition rather than sheer volume. Yet, optimal mixing is hindered by categorization flaws: