Emulate or Estimate? The Divergent Strengths of Base and Post-Trained Language Models for Opinion Simulation

Seth Grief-Albert, Jessica Bo, Difan Jiao, Ashton Anderson


Abstract
Large language models are increasingly used to simulate human opinions, but prior work reports conflicting results: some studies find promising alignment with human survey data, while others find persona collapse and weak demographic sensitivity. We propose that much of this conflict stems from conflating two distinct tasks. We call the first task emulation, in which models generate individual responses that aggregate into a population distribution. We call the second task estimation, in which models directly predict the population distribution. Evaluating six matched base and post-trained models on the Pew American Trends Panel, we find that base models are the stronger emulators: they produce response distributions closer to human ground truth and better preserve demographic structure. Post-trained models are generally the stronger estimators, producing more accurate distributional predictions when asked directly. We argue that model selection for human simulation should be guided by whether the task requires generating text or predicting distributions.
Anthology ID:
2026.findings-emnlp.1379
Volume:
Findings of the Association for Computational Linguistics: EMNLP 2026
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
Findings
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
29311–29320
Language:
URL:
https://aclanthology.org/2026.findings-emnlp.1379/
DOI:
Bibkey:
Cite (ACL):
Seth Grief-Albert, Jessica Bo, Difan Jiao, and Ashton Anderson. 2026. Emulate or Estimate? The Divergent Strengths of Base and Post-Trained Language Models for Opinion Simulation. In Findings of the Association for Computational Linguistics: EMNLP 2026, pages 29311–29320, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
Emulate or Estimate? The Divergent Strengths of Base and Post-Trained Language Models for Opinion Simulation (Grief-Albert et al., Findings 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.findings-emnlp.1379.pdf