Does Sensitivity to Pragmatic Norms Emerge with More Parameters, More Data, or More Conversations?

Raha Askari, Judith Sieker, Valerio Basile, Sina Zarrieß


Abstract
While previous work has examined the ability of language models (LMs) to capture pragmatic patterns, it remains understudied to what extent these abilities are shaped by training conditions. To address this gap, we test several models using an existing evaluation paradigm targeting LMs’ sensitivity to conversational norms (Askari et al. 2025). Across three experimental settings, we investigate the role of model size, training dynamics, and data composition in shaping pragmatic competence. Our results show that different pragmatic abilities exhibit distinct learning dynamics across models with varying sizes. While size or data scaling lead to inconsistent gains, exposure to conversational data causes moderate improvements in a modest training setting. Together, our findings suggest that pragmatic competence in LMs is heterogeneous and highlight the importance of targeted training conditions over scale alone for developing pragmatically sensitive models.
Anthology ID:
2026.emnlp-main.1718
Volume:
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
EMNLP
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
39201–39216
Language:
URL:
https://aclanthology.org/2026.emnlp-main.1718/
DOI:
Bibkey:
Cite (ACL):
Raha Askari, Judith Sieker, Valerio Basile, and Sina Zarrieß. 2026. Does Sensitivity to Pragmatic Norms Emerge with More Parameters, More Data, or More Conversations?. In Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing, pages 39201–39216, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
Does Sensitivity to Pragmatic Norms Emerge with More Parameters, More Data, or More Conversations? (Askari et al., EMNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.emnlp-main.1718.pdf