Ordinal-Aware Calibration for Ordinal Classification

arXiv:2410.15658v4 Announce Type: replace-cross Abstract: Deep neural networks frequently produce overconfident, miscalibrated predictions. In ordinal classification, predictions must also adhere to a unimodal and order-consistent structure, a requirement that has dominated prior work while overlooking calibration. We formalize this joint challenge as ordinal calibration for the first time and propose the Ordinal loss for Calibration and Unimodality (ORCU). Unlike incremental modular combinations, ORCU provides a concise, principled unification of distance-aware soft encoding and an ordinal-aware log-barrier extension on adjacent logit gaps. This coupling is theoretically synergetic: soft-encoded targets pre-condition the optimization landscape by providing a finite, full-support ordinal anchor for well-posed refinement, while the log-barrier extension preserves non-vanishing adjacent-gap gradients in the unimodality-feasible interior. This enables the log-barrier to refine confidence without disrupting the ordinal geometry. ORCU requires no architectural changes or post-hoc calibration. Across four ordinal benchmarks, it achieves state-of-the-art calibration without compromising accuracy. We establish a new reliability standard by providing a reproducible benchmark over 10 specialized and general-purpose loss functions. Our code is available at https://github.com/labhai/ORCU.

Related

• An uncertainty-aware Bayesian framework for machine learning classification models: A case study in land cover classification
• A Leakage-Aware Comparative Benchmark of Machine Learning, Deep Learning, and Transformer Models for Reliable Leukemia Detection
• Target-Agnostic Calibration under Distribution Shift with Frequency-Aware Gradient Rectification

Source: arXiv cs.CV | 2026-08-17