Auditing Chinese Web-scale Corpora via Sampled BPE Token Statistics
DGX agentarXiv:2608.10678v1 Announce Type: cross Abstract: Chinese web pollution has surfaced in LLMs, motivating audits of upstream Chinese corpora. However, auditing such corpora faces three challenges: (1)