Multipath parsing in the brain

Berta Franzluebbers, Donald Dunagan, Miloš Stanojević, Jan Buys, John Hale


Abstract
Humans understand sentences word-by-word, in the order that they hear them. This incrementality entails resolving temporary ambiguities about syntactic relationships. We investigate how humans process these syntactic ambiguities by correlating predictions from incremental generative dependency parsers with timecourse data from people undergoing functional neuroimaging while listening to an audiobook. In particular, we compare competing hypotheses regarding the number of developing syntactic analyses in play during word-by-word comprehension: one vs more than one. This comparison involves evaluating syntactic surprisal from a state-of-the-art dependency parser with LLM-adapted encodings against an existing fMRI dataset. In both English and Chinese data, we find evidence for multipath parsing. Brain regions associated with this multipath effect include bilateral superior temporal gyrus.
Anthology ID:
2024.acl-long.660
Volume:
Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Month:
August
Year:
2024
Address:
Bangkok, Thailand
Editors:
Lun-Wei Ku, Andre Martins, Vivek Srikumar
Venue:
ACL
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
12215–12229
Language:
URL:
https://aclanthology.org/2024.acl-long.660
DOI:
Bibkey:
Cite (ACL):
Berta Franzluebbers, Donald Dunagan, Miloš Stanojević, Jan Buys, and John Hale. 2024. Multipath parsing in the brain. In Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 12215–12229, Bangkok, Thailand. Association for Computational Linguistics.
Cite (Informal):
Multipath parsing in the brain (Franzluebbers et al., ACL 2024)
Copy Citation:
PDF:
https://aclanthology.org/2024.acl-long.660.pdf