Research
Uncertainty-Aware Web-Conditioned Scientific Fact-Checking
arXiv:2604.11036v1 Announce Type: cross Abstract: Scientific fact-checking is vital for assessing claims in specialized domains such as biomedicine and materials science, yet existing systems often ha
arXiv:2604.11036v1 Announce Type: cross Abstract: Scientific fact-checking is vital for assessing claims in specialized domains such as biomedicine and materials science, yet existing systems often hallucinate or apply inconsistent reasoning, especially when verifying technical, compositional claims against an evidence snippet under source and cost/latency constraints. We present a pipeline centered on atomic predicate-argument decomposition and calibrated, uncertainty-gated corroboration: atomic facts are aligned to local snippets via embeddings, verified by a compact evidence-grounded checker, and only facts with uncertain support trigger domain-restricted web search over authoritative sources. The system supports both binary and tri-valued classification where it predicts labels from Supported, Refuted, NEI for three-way tasks. We evaluate under two regimes, Context-Only (no web) and Context+Web (uncertainty-gated web corroboration); when retrieved evidence conflicts with the provided context, we abstain with NEI rather than overriding the context. On multiple benchmarks, our framework surpasses the strongest benchmarks. In our experiments, web corroboration was invoked for only a minority of atomic facts on average, indicating that external evidence is consulted selectively under calibrated uncertainty rather than routinely. Overall, coupling atomic granularity with calibrated, uncertainty-gated corroboration yields more interpretable and context-conditioned verification, making the approach well-suited to high-stakes, single-document settings that demand traceable rationales, predictable cost/latency, and conservative.
Related
- When Verification Fails: How Compositionally Infeasible Claims Escape Rejection
- Hallucination as output-boundary misclassification: a composite abstention architecture for language models
- Scientific Knowledge-driven Decoding Constraints Improving the Reliability of LLMs
- TokUR: Token-Level Uncertainty Estimation for Large Language Model Reasoning
- Variational Visual Question Answering for Uncertainty-Aware Selective Prediction
- A Graph-Enhanced Defense Framework for Explainable Fake News Detection with LLM
Source: arXiv cs.AI | 2026-04-14