Global Sequential Testing for Multi-Stream Auditing

arXiv:2602.21479v2 Announce Type: replace-cross Abstract: Across many risk-sensitive areas, it is critical to continuously audit machine learning systems as we receive more data to quickly determine if they are performing as designed. This auditing task can be modeled as a sequential hypothesis testing problem with k data streams and a global null hypothesis that asserts the system operates as intended across all k streams. Under the alternative, the standard global sequential test, which uses a Bonferroni correction, has an expected stopping time of Oleft(ln frac{k}{alpha}right) for large k and significance level alpha. In this work, we demonstrate that efficient sequential tests, relying on merging martingales via averaging and products rules, provide improved stopping times, and thus more powerful tests against the null. Using these results, we show that a balanced test can match the Bonferroni rate of Oleft(ln frac{k}{alpha}right) in the sparse regime (just a few non-null streams) while achieving Oleft(frac{1}{k}ln frac{1}{alpha}right) under dense alternatives (many non-null steams). We validate our theory through experiments on both synthetic and real-world data.

Source: arXiv cs.LG | 2026-05-26