Modal Sense Disambiguation in Language Models: The Role of Context, Training Domain, and Input Frequency

Ezgi Başar, Yevgen Matusevych, Annemarie van Dooren, Arianna Bisazza


Abstract
Modals such as may and must can take on different senses depending on discourse context, alternating between root interpretations (e.g., permission, obligation) and epistemic interpretations (e.g., knowledge, belief). While modals are known to be notoriously difficult for children to acquire, limited research exists on whether language models (LMs) can reliably distinguish between different modal senses. We evaluate seven LMs that vary in architecture, size, and training data type using vector-based similarity and surprisal measures across four datasets. Specifically, we investigate whether LMs can leverage contextual information to disambiguate modal senses and whether their performance reflects the distribution of modal senses in their training data. We show that larger LMs trained on diverse text successfully leverage additional contextual information when available. In the absence of context, they tend to favor the dominant sense based on corpus statistics. Smaller developmentally plausible LMs, including those trained on child-directed language (CDL), fail to show consistent sensitivity to modal sense distinctions and do not benefit from context to the same degree.
Anthology ID:
2026.findings-emnlp.1044
Volume:
Findings of the Association for Computational Linguistics: EMNLP 2026
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
Findings
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
22112–22129
Language:
URL:
https://aclanthology.org/2026.findings-emnlp.1044/
DOI:
Bibkey:
Cite (ACL):
Ezgi Başar, Yevgen Matusevych, Annemarie van Dooren, and Arianna Bisazza. 2026. Modal Sense Disambiguation in Language Models: The Role of Context, Training Domain, and Input Frequency. In Findings of the Association for Computational Linguistics: EMNLP 2026, pages 22112–22129, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
Modal Sense Disambiguation in Language Models: The Role of Context, Training Domain, and Input Frequency (Başar et al., Findings 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.findings-emnlp.1044.pdf