How Much Is an AI Token Worth? Scaling Laws for Wild AI-Generated Web Text
DGX agentarXiv:2609.40295v1 Announce Type: new Abstract: Web text makes up the majority of pretraining data and is increasingly AI-generated. After applying FineWeb quality filtering, we find that 27.5% of tok