Computational surprisal is not enough: Discourse prominence modulates human eye-movement patterns but not GPT expectations in Korean

Nayoung Kwon, Gyu-Ho Shin, Seongmin Mun


Abstract
Large Language Model (LLM) surprisal is increasingly used as a proxy for human sentence processing, yet whether model expectations reflect the cognitive factors governing real-time human behavior remains uncertain. We examine Korean subject–verb honorific agreement in subject- and object-control constructions, where human eye-tracking data reveal a prominence-driven asymmetry. Evaluating three Korean-capable models, we find that surprisal was sensitive to honorific-feature mismatches, yielding attraction-like effects, but was not modulated by distractor prominence. Although surprisal selectively improved reading-time predictions, this reflected item-level predictive overlap rather than prominence sensitivity. GPT models thus capture surface regularities but do not reproduce the construction-sensitive, prominence-driven asymmetry of human dependency resolution, suggesting that LLMs diverge from humans precisely where processing depends on working-memory constraints rather than distributional expectation.
Anthology ID:
2026.findings-emnlp.1443
Volume:
Findings of the Association for Computational Linguistics: EMNLP 2026
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
Findings
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
30783–30796
Language:
URL:
https://aclanthology.org/2026.findings-emnlp.1443/
DOI:
10.18653/2026.findings-emnlp.1443
Bibkey:
Cite (ACL):
Nayoung Kwon, Gyu-Ho Shin, and Seongmin Mun. 2026. Computational surprisal is not enough: Discourse prominence modulates human eye-movement patterns but not GPT expectations in Korean. In Findings of the Association for Computational Linguistics: EMNLP 2026, pages 30783–30796, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
Computational surprisal is not enough: Discourse prominence modulates human eye-movement patterns but not GPT expectations in Korean (Kwon et al., Findings 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.findings-emnlp.1443.pdf