Research
Reducing Hallucinations in LLM-based Scientific Literature Analysis Using Peer Context Outlier Detection
arXiv:2604.01461v2 Announce Type: replace Abstract: Reducing hallucinations in Large Language Models (LLMs) is essential for accurate data extraction from large text corpora. Current methods, like pro
arXiv:2604.01461v2 Announce Type: replace Abstract: Reducing hallucinations in Large Language Models (LLMs) is essential for accurate data extraction from large text corpora. Current methods, like prompt engineering and chain-of-thought prompting, focus on individual documents and fail to consider relationships across a corpus. This paper introduces Peer Context Outlier Detection (P-COD), which uses inter-document relationships to improve extraction accuracy in scientific literature summarization, where papers with similar experiment settings should draw similar conclusions. By comparing extracted data to validated peer information within the corpus, we adjust confidence scores and flag low-confidence results for expert review. Our experiments demonstrate up to 98% precision in outlier detection across 6 scientific domains, reducing hallucinations and letting researchers focus on genuinely ambiguous cases.
Related
- Spatial Priming Outperforms Semantic Prompting: A Grid-Based Approach to Improving LLM Accuracy on Chart Data Extraction
- From Rubrics to Reliable Scores: Evidence-Grounded Text Evaluation with LLM Judges
- Leveraging Few-Shot Learning and Large Language Models for Analyzing Blood Pressure Variations Across Biological Sex from Scientific Literature
- Improved Evidence Extraction and Metrics for Document Inconsistency Detection with LLMs
Source: arXiv cs.AI | 2026-09-10