Hubs or Fringes: Pretraining Data Selection via Web Graph Centrality
arXiv:2606.11499v1 Announce Type: cross Abstract: The performance of modern language models depends critically on pretraining data composition. Yet existing data selection methods rely on auxiliary cl