Using Prosody to Predict Syntactic Structure

Junghyun Min, Alex Warstadt, Tamar I Regev, Tiago Pimentel, Ethan Gotlieb Wilcox


Abstract
While it is well-established that prosody carries crucial cues for syntactic structure, the degree and nature of correspondence between these two domains remains contested. We investigate the syntax-prosody interface through an information-theoretic lens, quantifying the interaction between prosodic features and syntactic representations as their mutual information. We provide a general-purpose framework for estimating this quantity over large speech-text corpora using multimodal language models. Our framework is structure-agnostic and modular, insofar as it can be used to measure the contributions of individual prosodic features or components of structure. We evaluate the syntax-prosody relationship for two features (word duration and inter-word pauses) across two domains–read audiobooks and spontaneous conversations–both in English. Our results demonstrate that prosody contains measurable syntactic information, with prosodic features reducing syntactic uncertainty in spontaneous conversations by up to 10.2%. Our findings offer new empirical support for several theoretical accounts of the syntax-prosody interface.
Anthology ID:
2026.emnlp-main.1761
Volume:
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
EMNLP
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
40145–40159
Language:
URL:
https://aclanthology.org/2026.emnlp-main.1761/
DOI:
Bibkey:
Cite (ACL):
Junghyun Min, Alex Warstadt, Tamar I Regev, Tiago Pimentel, and Ethan Gotlieb Wilcox. 2026. Using Prosody to Predict Syntactic Structure. In Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing, pages 40145–40159, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
Using Prosody to Predict Syntactic Structure (Min et al., EMNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.emnlp-main.1761.pdf