Beyond Modern Asymptotics for Log-Likelihood Ratios in Logistic Regression

arXiv:2608.02507v1 Announce Type: cross Abstract: We characterize the finite sample behavior of the log-likelihood ratio statistic in binary logistic regression, uniformly over both the design and the target parameter. For ngeq dgeq 3, we determine, up to universal constants, its worst case (1-elta) quantile over all fixed collections of design vectors and all target parameters: [ dlogleft(frac{e n}{d}right)+logleft(frac{1}{elta}right). ] This is a nonasymptotic analogue of the Wilks hi^2_d phenomenon and requires no regularity assumptions on the design. The low dimensional cases exhibit unusual behavior. The worst case quantile in dimension d=2 is sharply of order [ logloglog n+logleft(frac{1}{elta}right). ] The worst case quantile in dimension d=1 is of order log(1/elta), with no dependence on n. Finally, i.i.d. Gaussian design vectors recover the classical Wilks scale. In the regime ngtrsim d+log(1/elta), we prove the sharp bound [ d+logleft(frac{1}{elta}right). ] Unlike existing asymptotic results, our bounds are uniform over the target parameter, which may depend on n, d, and elta.

Source: arXiv cs.LG | 2026-08-04