How Pragmatics Shape Articulation: A Computational Case Study in STEM ASL Discourse

Saki Imai, Lee Kezar, Laurel Aichler, Mert Inan, Erin Walker, Alicia Wooten, Lorna Cobban Quandt, Malihe Alikhani


Abstract
Most state-of-the-art sign language models are trained on interpreter or isolated vocabulary data, which overlooks the variability that characterizes natural dialogue. However, human communication dynamically adapts to contexts and interlocutors through spatiotemporal changes and articulation style. This specifically manifests itself in educational settings, where novel vocabularies are used by teachers, and students. To address this gap, we collect a motion capture dataset of American Sign Language (ASL) STEM (Science, Technology, Engineering, and Mathematics) dialogue that enables quantitative comparison between dyadic interactive signing, solo signed lecture, and interpreted articles. Using continuous kinematic features, we disentangle dialogue-specific entrainment from individual effort reduction and show spatiotemporal changes across repeated mentions of STEM terms. On average, dialogue signs are 24.6%-44.6% shorter in duration than the isolated signs, and show significant reductions absent in monologue contexts. Finally, we evaluate sign embedding models on their ability to recognize STEM signs and approximate how entrained the participants become over time. Our study bridges linguistic analysis and computational modeling to understand how pragmatics shape sign articulation and its representation in sign language technologies.
Anthology ID:
2026.lrec-1.669
Volume:
Proceedings of the Fifteenth Language Resources and Evaluation Conference
Month:
May
Year:
2026
Address:
Palma de Mallorca, Spain
Editors:
Stelios Piperidis, Núria Bel, Henk van den Heuvel, Nancy Ide, Simon Krek, Antonio Toral
Venue:
LREC
SIG:
Publisher:
ELRA Language Resource Association
Note:
Pages:
8476–8490
Language:
External URL:
https://lrec.elra.info/lrec2026-main-669
DOI:
10.63317/2wjnaaabgz4d
Bibkey:
Cite (ACL):
Saki Imai, Lee Kezar, Laurel Aichler, Mert Inan, Erin Walker, Alicia Wooten, Lorna Cobban Quandt, and Malihe Alikhani. 2026. How Pragmatics Shape Articulation: A Computational Case Study in STEM ASL Discourse. In Proceedings of the Fifteenth Language Resources and Evaluation Conference, pages 8476–8490, Palma de Mallorca, Spain. ELRA Language Resource Association.
Cite (Informal):
How Pragmatics Shape Articulation: A Computational Case Study in STEM ASL Discourse (Imai et al., LREC 2026)
Copy Citation: