Applications
SCRIBE: Scalable Contextual Representations of Interpretable Brain-Grounded Semantics
arXiv:2610.21518v1 Announce Type: new Abstract: Understanding how the human brain constructs meaning from real-world language remains a fundamental challenge, as semantics depend on context that varie
arXiv:2610.21518v1 Announce Type: new Abstract: Understanding how the human brain constructs meaning from real-world language remains a fundamental challenge, as semantics depend on context that varies in natural settings. To enable the study of real-world linguistic meaning in the brain, we introduce SCRIBE, a framework grounded in a neuroscience-informed semantic space that leverages an ensemble of open-source large language models to generate interpretable, word-level semantic representations of arbitrary text. In a behavioral study with 921 participants, we show that human semantic feature judgments vary systematically with context, and that SCRIBE captures these shifts, reaching 75-81% of the estimated human noise ceiling. Using brain activity recorded while participants listen to naturalistic stories, we further demonstrate that SCRIBE predicts neural responses in language-selective brain regions, significantly outperforming non-contextual semantic representations. Variance partitioning reveals that SCRIBE explains unique brain-predictive information beyond syntactic features, suggesting that its representations capture aspects of linguistic meaning not accounted for by the measured syntactic features. Together, these findings establish SCRIBE as a scalable and interpretable foundation for studying natural language semantics in the brain.
Related
- Finding Interpretable Prompt-Specific Circuits in Language Models
- TacReasoner: A Dynamic Tactile-Language Framework for Interactive Reasoning in Real-World Scenarios
- Rethinking Gating Mechanism in Sparse MoE: Handling Arbitrary Modality Inputs with Confidence-Guided Gate
Source: arXiv cs.AI | 2026-10-16