Eyes on the Parse: Using Gaze Features in Syntactic Parsing

Abhishek Agrawal, Rudolf Rosa


Abstract
In this paper, we explore the potential benefits of leveraging eye-tracking information for dependency parsing on the English part of the Dundee corpus. To achieve this, we cast dependency parsing as a sequence labelling task and then augment the neural model for sequence labelling with eye-tracking features. We also augment a graph-based parser with eye-tracking features and parse the Dundee Corpus to corroborate our findings from the sequence labelling parser. We then experiment with a variety of parser setups ranging from parsing with all features to a delexicalized parser. Our experiments show that for a parser with all features, although the improvements are positive for the LAS score they are not significant whereas our delexicalized parser significantly outperforms the baseline we established. We also analyze the contribution of various eye-tracking features towards the different parser setups and find that eye-tracking features contain information which is complementary in nature, thus implying that augmenting the parser with various gaze features grouped together provides better performance than any individual gaze feature.
Anthology ID:
2020.lantern-1.1
Volume:
Proceedings of the Second Workshop on Beyond Vision and LANguage: inTEgrating Real-world kNowledge (LANTERN)
Month:
December
Year:
2020
Address:
Barcelona, Spain
Editors:
Aditya Mogadala, Sandro Pezzelle, Dietrich Klakow, Marie-Francine Moens, Zeynep Akata
Venue:
LANTERN
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
1–16
Language:
URL:
https://aclanthology.org/2020.lantern-1.1
DOI:
Bibkey:
Cite (ACL):
Abhishek Agrawal and Rudolf Rosa. 2020. Eyes on the Parse: Using Gaze Features in Syntactic Parsing. In Proceedings of the Second Workshop on Beyond Vision and LANguage: inTEgrating Real-world kNowledge (LANTERN), pages 1–16, Barcelona, Spain. Association for Computational Linguistics.
Cite (Informal):
Eyes on the Parse: Using Gaze Features in Syntactic Parsing (Agrawal & Rosa, LANTERN 2020)
Copy Citation:
PDF:
https://aclanthology.org/2020.lantern-1.1.pdf
Data
Universal Dependencies