Resolving Prepositional Phrase Attachment Ambiguities with Contextualized Word Embeddings

Adwait Ratnaparkhi, Atul Kumar


Abstract
This paper applies contextualized word embedding models to a long-standing problem in the natural language parsing community, namely prepositional phrase attachment. Following past formulations of this problem, we use data sets in which the attachment decision is both a binary-valued choice as well as a multi-valued choice. We present a deep learning architecture that fine-tunes the output of a contextualized word embedding model for the purpose of predicting attachment decisions. We present experiments on two commonly used datasets that outperform the previous best results, using only the original training data and the unannotated full sentence context.
Anthology ID:
2021.icon-main.40
Volume:
Proceedings of the 18th International Conference on Natural Language Processing (ICON)
Month:
December
Year:
2021
Address:
National Institute of Technology Silchar, Silchar, India
Editors:
Sivaji Bandyopadhyay, Sobha Lalitha Devi, Pushpak Bhattacharyya
Venue:
ICON
SIG:
Publisher:
NLP Association of India (NLPAI)
Note:
Pages:
335–340
Language:
URL:
https://aclanthology.org/2021.icon-main.40
DOI:
Bibkey:
Cite (ACL):
Adwait Ratnaparkhi and Atul Kumar. 2021. Resolving Prepositional Phrase Attachment Ambiguities with Contextualized Word Embeddings. In Proceedings of the 18th International Conference on Natural Language Processing (ICON), pages 335–340, National Institute of Technology Silchar, Silchar, India. NLP Association of India (NLPAI).
Cite (Informal):
Resolving Prepositional Phrase Attachment Ambiguities with Contextualized Word Embeddings (Ratnaparkhi & Kumar, ICON 2021)
Copy Citation:
PDF:
https://aclanthology.org/2021.icon-main.40.pdf
Code
 adwaitratnaparkhi/ppa_transformer
Data
FrameNetPenn Treebank