Understanding Subjectivity Transformation in Academic Meta-Review Generation

Sanju Basak, Suining He


Abstract
Academic meta-reviews must synthesize several reviewer opinions into a single, consistent judgment, balancing verifiable factual claims against subjective evaluations. Yet how human meta-reviewers transform reviewer subjectivity during summarization and whether large language models (LLMs) reproduce this behavior remains under-explored. To address this, we characterize subjectivity transformation in academic meta-review writing using a sentence-level subjectivity scorer, evaluating four open LLMs across six prompt configurations. Our analysis reveals that meta-review writing performs a regression to the mean of subjectivity: when a meta-review sentence is matched to its source reviewer’s sentence, the change in subjectivity negatively correlates with the source’s original subjectivity. In particular, actual, individual reviewer statements are made more interpretive, while highly subjective language tends to be moderated toward a balanced tone. All four open LLMs reproduce such a transformation closely. Conditioning the prompt on reviewer subjectivity yields only a small calibration gain where the generated meta-review’s overall subjectivity moves slightly closer to the human reference, yet leaves the transformation itself unchanged, implying that there exists a robust latent behavior of LLM summarization rather than a prompt-controllable one.
Anthology ID:
2026.findings-emnlp.1922
Volume:
Findings of the Association for Computational Linguistics: EMNLP 2026
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
Findings
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
40975–40990
Language:
URL:
https://aclanthology.org/2026.findings-emnlp.1922/
DOI:
10.18653/2026.findings-emnlp.1922
Bibkey:
Cite (ACL):
Sanju Basak and Suining He. 2026. Understanding Subjectivity Transformation in Academic Meta-Review Generation. In Findings of the Association for Computational Linguistics: EMNLP 2026, pages 40975–40990, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
Understanding Subjectivity Transformation in Academic Meta-Review Generation (Basak & He, Findings 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.findings-emnlp.1922.pdf