Measuring Data Diversity with Embeddings: A Taxonomy and Benchmark for Diversity Measures
DGX agentarXiv:2610.24888v1 Announce Type: cross Abstract: Diversity is a critical property of text corpora, with direct implications for training data curation, test set design, and model generalization. Howe