Can Large Language Models Uncover the Structure of Social Opinions?

Chongrui Ye, Yuxiang Liu, Haofei Yu, Jiayu Liu, Jiaxuan You


Abstract
Understanding how opinions on different issues evolve together is essential for modeling collective intelligence, yet this remains underexplored due to the absence of standardized benchmarks. We introduce the concept of an opinion graph, where nodes represent social opinions on real-world events (e.g., presidential elections, stock predictions) and edges capture pairwise relationships between them. Building on this, we present OpinionBench, a continuously evolving benchmark derived from multiple live prediction markets, designed to evaluate whether large language models (LLMs) can uncover the latent structure within evolving social opinions. OpinionBench employs an scalable and automated graph construction and labeling pipeline, which assigns edge labels using time-series co-movement, semantic similarity, and metadata, followed by human validation. Experiments show that (1) LLMs consistently outperform baselines in identifying opinion correlations across domains, and (2) LLMs can recover the underlying graph structure through edge prediction. OpinionBench provides a challenging testbed for assessing LLMs’ ability to capture complex patterns of social opinion co-evolution.
Anthology ID:
2026.findings-emnlp.505
Volume:
Findings of the Association for Computational Linguistics: EMNLP 2026
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
Findings
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
10584–10606
Language:
URL:
https://aclanthology.org/2026.findings-emnlp.505/
DOI:
Bibkey:
Cite (ACL):
Chongrui Ye, Yuxiang Liu, Haofei Yu, Jiayu Liu, and Jiaxuan You. 2026. Can Large Language Models Uncover the Structure of Social Opinions?. In Findings of the Association for Computational Linguistics: EMNLP 2026, pages 10584–10606, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
Can Large Language Models Uncover the Structure of Social Opinions? (Ye et al., Findings 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.findings-emnlp.505.pdf