AGSC: Adaptive Granularity and Semantic Clustering for Uncertainty Quantification in Long-text Generation

arXiv:2604.06812v2 Announce Type: replace Abstract: Large Language Models (LLMs) have demonstrated impressive capabilities in long-form generation, yet their application is hindered by the hallucination problem. While Uncertainty Quantification (UQ) is essential for assessing reliability, the complex structure makes reliable aggregation across heterogeneous themes difficult, in addition, existing methods often overlook the nuance of neutral information and suffer from the high computational cost of fine-grained decomposition. To address these challenges, we propose AGSC (Adaptive Granularity and GMM-based Semantic Clustering), a UQ framework tailored for long-form generation. AGSC first uses NLI neutral probabilities as triggers to distinguish irrelevance from uncertainty, reducing unnecessary computation. It then applies Gaussian Mixture Model (GMM) soft clustering to model latent semantic themes and assign topic-aware weights for downstream aggregation. Experiments on BIO and LongFact show that AGSC achieves state-of-the-art correlation with factuality while reducing inference time by about 60% compared to full atomic decomposition.

Related

• Think Through Uncertainty: Improving Long-Form Generation Factuality via Reasoning Calibration
• TokUR: Token-Level Uncertainty Estimation for Large Language Model Reasoning
• Adaptive Multi-Expert Reasoning via Difficulty-Aware Routing and Uncertainty-Guided Aggregation
• Hidden Failures in Robustness: Why Supervised Uncertainty Quantification Needs Better Evaluation

Source: arXiv cs.CL | 2026-04-15