Model Releases
Structure of Basic Human Values in Russian Social Media
arXiv:2603.18822v2 Announce Type: replace Abstract: What is known about the values of national populations rests almost entirely on questionnaires, which prompt respondents to rate researcher-supplied
arXiv:2603.18822v2 Announce Type: replace Abstract: What is known about the values of national populations rests almost entirely on questionnaires, which prompt respondents to rate researcher-supplied descriptions of each motivation. Social media instead records values as they are invoked spontaneously, in communication addressed to a real audience. We measure value expression in broadly sampled, heterogeneous Russian-language social-media data, where value-relevant content is sparse and often ambiguous, and read the result against the survey-based profile of the same population. To address subjectivity in value interpretation, we compare alternative LLM-prompt configurations against expert judgments and use error-driven calibration to select a theory-based operationalization. Using VKontakte data collected from one million randomly generated user IDs, comprising 7.5 million public text posts, we develop a multi-stage framework combining candidate selection, repeated LLM annotation, and transfer to an XLM-RoBERTa encoder for large-scale prediction (a macro PR-AUC of .60 on the expert benchmark, with continuous scores positively correlated with graded expert confidence across all ten values). The circular structure proposed by Schwartz is largely recovered (congruence .95 at the post level, .94 at the user level). The aggregate profile agrees with survey findings at the anchors - Benevolence highest and broadly distributed across users, Power lowest - but shows relatively elevated Hedonism and relatively low Universalism. Universalism is further displaced structurally, co-expressed with Security and Tradition and concentrated in the output of highly active users.
Related
- The Role of Dataset Linguistic Structure in the Cultural Awareness of Large Language Models
- Quantifying and Mitigating Socially Desirable Responding in LLMs: A Desirability-Matched Graded Forced-Choice Psychometric Study
- Sampling Reveals Style: Unsupervised, Training-Free Discovery of Prompt-Conditional Stylistic Axes in LLM Activations
Source: arXiv cs.CL | 2026-10-01