Model Releases
MMD-Flagger: Leveraging Maximum Mean Discrepancy to Detect Hallucinations
arXiv:2506.01367v4 Announce Type: replace Abstract: Large Language Models (LLMs) are increasingly integrated into agentic AI systems, yet their propensity to generate hallucinations remains a critical
arXiv:2506.01367v4 Announce Type: replace Abstract: Large Language Models (LLMs) are increasingly integrated into agentic AI systems, yet their propensity to generate hallucinations remains a critical safety concern. Detecting these factual errors at test-time, particularly without ground-truth labels, is essential for building trustworthy autonomous agents. We propose MMD-Flagger, an hallucination detection method that utilizes Maximum Mean Discrepancy (MMD) and monitors the stability of LLM outputs across varying decoding temperatures. Our method tracks the MMD trajectory between a LLM's response at a certain decoding configuration and a set of stochastic samples, identifying hallucinations based on the trajectory's characteristic shape. We evaluate MMDFlagger on multi-lingual claim verification benchmarks (MUCH) using modern LLMs like Llama-3 families and Gemma-3.
Related
- When and What to Ask: AskBench and Rubric-Guided RLVR for LLM Clarification
- Same Question, Different Answer? Measuring and Mitigating Prompt Privilege for Equitable AI Access
- PRISM: Probing Reasoning, Instruction, and Source Memory in LLM Hallucinations
Source: arXiv cs.CL | 2026-08-20