Regret Tail Characterization of Optimal Bandit Algorithms with Generic Rewards

arXiv:2604.14876v1 Announce Type: cross Abstract: We study the tail behavior of regret in stochastic multi-armed bandits for algorithms that are asymptotically optimal in expectation. While minimizing expected regret is the classical objective, recent work shows that even such algorithms can exhibit heavy regret tails, incurring large regret with non-negligible probability. Existing sharp characterizations of regret tails are largely restricted to parametric settings, such as single-parameter exponential families. In this work, we extend the KLinf-UCB algorithm of to a broad nonparametric class of reward distributions satisfying mild assumptions, and establish its asymptotic optimality in expectation. We then analyze the tail behavior of its regret and derive a novel upper bound on the regret tail probability. As special cases, our results recover regret-tail guarantees for both bounded-support and heavy-tailed (moment-bounded) bandit models. Moreover, for the special case of finitely-supported reward distributions, our upper bound matches the known lower bound exactly. Our results thus provide a unified and tight characterization of regret tails for asymptotically optimal KL-based UCB algorithms, going beyond parametric models.

Related

• Best of both worlds: Stochastic & adversarial best-arm identification
• Covariance-adapting algorithm for semi-bandits with application to sparse rewards
• Are Stochastic Multi-objective Bandits Harder than Single-objective Bandits?
• Replicable Bandits with UCB based Exploration
• A Modularized Framework for Piecewise-Stationary Restless Bandits

Source: arXiv cs.LG | 2026-04-17