Research
Comparing Human and Large Language Model Interpretation of Implicit Information
arXiv:2604.17085v1 Announce Type: new Abstract: The interpretation of implicit meanings is an integral aspect of human communication. However, this framework may not transfer to interactions with Larg
arXiv:2604.17085v1 Announce Type: new Abstract: The interpretation of implicit meanings is an integral aspect of human communication. However, this framework may not transfer to interactions with Large Language Models (LLMs). To investigate this, we introduce the task of Implicit Information Extraction (IIE) and propose an LLM-based IIE pipeline that builds a structured knowledge graph from a context sentence by extracting relational triplets, validating implicit inferences, and analyzing temporal relations. We evaluate two LLMs against crowdsourced human judgments on two datasets. We find that humans agree with most model triplets yet consistently propose many additions, indicating limited coverage in current LLM-based IIE. Moreover, in our experiments, models appear to be more conservative about implicit inferences than humans in socially rich contexts, whereas humans become more conservative in shorter, fact-oriented contexts. Our code is available at https://github.com/Antonio-Dee/IIE_from_LLM.
Related
- Temporal Flattening in LLM-Generated Text: Comparing Human and LLM Writing Trajectories
- ReasonScaffold: A Scaffolded Reasoning-based Annotation Protocol for Human-AI Co-Annotation
- Psychological Steering of Large Language Models
- Better and Worse with Scale: How Contextual Entrainment Diverges with Model Size
Source: arXiv cs.CL | 2026-04-21