Beyond Lexical and Syntactic: Better Text Simplicity Analysis Informed by Psycholinguistic Research

Benjamin Vendeville, Liana Ermakova, Pierre De Loor


Abstract
Automatic text simplification measures correlate poorly with human judgments and are disconnected from psycholinguistic research on comprehension. We propose a multidimensional analysis framework grounded in Cognitive Load Theory and the Construction-Integration model, organizing over 400 linguistic features into six simplicity dimensions targeting distinct comprehension stages. Using this framework, we analyze four human-annotated and six aligned simplification datasets. We find that (1) our dimensions predict human simplicity judgments better than established measures on most datasets; (2) current datasets overwhelmingly target lexical and syntactic dimensions while under-targeting personalization the dimension psychological research identifies as most impactful for comprehension; and (3) existing measures overall do not capture any specific dimension. These findings provide actionable guidance for building measures and datasets better aligned with how readers actually process text.
Anthology ID:
2026.findings-emnlp.2159
Volume:
Findings of the Association for Computational Linguistics: EMNLP 2026
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
Findings
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
46173–46191
Language:
URL:
https://aclanthology.org/2026.findings-emnlp.2159/
DOI:
Bibkey:
Cite (ACL):
Benjamin Vendeville, Liana Ermakova, and Pierre De Loor. 2026. Beyond Lexical and Syntactic: Better Text Simplicity Analysis Informed by Psycholinguistic Research. In Findings of the Association for Computational Linguistics: EMNLP 2026, pages 46173–46191, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
Beyond Lexical and Syntactic: Better Text Simplicity Analysis Informed by Psycholinguistic Research (Vendeville et al., Findings 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.findings-emnlp.2159.pdf