A Control Function Framework for Mitigating Position Bias in Learning to Rank Systems

arXiv:2506.06989v3 Announce Type: replace-cross Abstract: Learning-to-rank (LTR) systems commonly depend on implicit feedback, such as user clicks, because it is easy to collect and can serve as a valuable signal of user preferences. However, directly optimizing ranking models using implicit feedback data often yields suboptimal performance because such data is inherently skewed by systematic biases. Among these biases, position bias is particularly pervasive: items ranked higher tend to receive disproportionately more interactions, regardless of their actual relevance. To address this, we introduce a novel two-stage framework based on control functions. In the first stage, we utilize exogenous variation from the residuals of the ranking process, which are then incorporated into a second stage click model to account for position-dependent distortions. In contrast to existing methods, our approach avoids explicit propensity estimation, supports nonlinear ranking models, and can be flexibly incorporated into any state-of-the-art ranking algorithm for position bias correction. We also propose a debiasing strategy for validation clicks that enables reliable hyperparameter tuning in the absence of unbiased validation data. Empirical results show that our method outperforms state-of-the-art position bias correction methods on both benchmark and real-world industrial datasets.

Source: arXiv cs.LG | 2026-08-11