MegaFake: A Theory-Driven Dataset of Fake News Generated by Large Language Models

arXiv:2408.11871v4 Announce Type: replace-cross Abstract: Fake news significantly influences decision-making processes by misleading individuals, organizations, and even governments. Large language models (LLMs), as part of generative AI, can amplify this problem by generating highly convincing fake news at scale, posing a significant threat to online information integrity. Therefore, understanding the motivations and mechanisms behind fake news generated by LLMs is crucial for effective detection and governance. In this study, we develop the LLM-Fake Theory, a theoretical framework that integrates various social psychology theories to explain machine-generated deception. Guided by this framework, we design an innovative prompt engineering pipeline that automates fake news generation using LLMs, eliminating manual annotation needs. Utilizing this pipeline, we create a theoretically informed nderline{M}achinnderline{e}-nderline{g}enernderline{a}ted nderline{Fake} news dataset, MegaFake, derived from FakeNewsNet. Through extensive experiments with MegaFake, we advance both theoretical understanding of human-machine deception mechanisms and practical approaches to fake news detection in the LLM era.

Related

• Overstating Attitudes, Ignoring Networks: LLM Biases in Simulating Misinformation Susceptibility
• Private Seeds, Public LLMs: Realistic and Privacy-Preserving Synthetic Data Generation
• Improved Evidence Extraction and Metrics for Document Inconsistency Detection with LLMs
• Hallucination as output-boundary misclassification: a composite abstention architecture for language models

Source: arXiv cs.AI | 2026-04-14