Query Timing Produces Opposite Positional Biases Between LLMs and Humans

Jasin Cekinmez, Addison J. Wu, Thomas L. Griffiths


Abstract
Positional biases such as recency and primacy effects have been documented in large language models (LLMs), yet the underlying mechanism by which these models make their evaluations remains poorly understood. Both primacy and recency biases have been observed in human judgments in response to evidence, but recent work suggest that when the listener updates their beliefs – during the presentation of evidence or only at the end – influences the presence of such effects. We investigate whether a similar phenomenon holds for LLMs, finding divergence from human behavior. These biases are more exacerbated in newer models compared to their predecessors.
Anthology ID:
2026.findings-emnlp.1354
Volume:
Findings of the Association for Computational Linguistics: EMNLP 2026
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
Findings
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
28741–28758
Language:
URL:
https://aclanthology.org/2026.findings-emnlp.1354/
DOI:
Bibkey:
Cite (ACL):
Jasin Cekinmez, Addison J. Wu, and Thomas L. Griffiths. 2026. Query Timing Produces Opposite Positional Biases Between LLMs and Humans. In Findings of the Association for Computational Linguistics: EMNLP 2026, pages 28741–28758, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
Query Timing Produces Opposite Positional Biases Between LLMs and Humans (Cekinmez et al., Findings 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.findings-emnlp.1354.pdf