Composing Noun Phrase Vector Representations

Aikaterini-Lida Kalouli, Valeria de Paiva, Richard Crouch


Abstract
Vector representations of words have seen an increasing success over the past years in a variety of NLP tasks. While there seems to be a consensus about the usefulness of word embeddings and how to learn them, it is still unclear which representations can capture the meaning of phrases or even whole sentences. Recent work has shown that simple operations outperform more complex deep architectures. In this work, we propose two novel constraints for computing noun phrase vector representations. First, we propose that the semantic and not the syntactic contribution of each component of a noun phrase should be considered, so that the resulting composed vectors express more of the phrase meaning. Second, the composition process of the two phrase vectors should apply suitable dimensions’ selection in a way that specific semantic features captured by the phrase’s meaning become more salient. Our proposed methods are compared to 11 other approaches, including popular baselines and a neural net architecture, and are evaluated across 6 tasks and 2 datasets. Our results show that these constraints lead to more expressive phrase representations and can be applied to other state-of-the-art methods to improve their performance.
Anthology ID:
W19-4311
Volume:
Proceedings of the 4th Workshop on Representation Learning for NLP (RepL4NLP-2019)
Month:
August
Year:
2019
Address:
Florence, Italy
Editors:
Isabelle Augenstein, Spandana Gella, Sebastian Ruder, Katharina Kann, Burcu Can, Johannes Welbl, Alexis Conneau, Xiang Ren, Marek Rei
Venue:
RepL4NLP
SIG:
SIGREP
Publisher:
Association for Computational Linguistics
Note:
Pages:
84–95
Language:
URL:
https://aclanthology.org/W19-4311
DOI:
10.18653/v1/W19-4311
Bibkey:
Cite (ACL):
Aikaterini-Lida Kalouli, Valeria de Paiva, and Richard Crouch. 2019. Composing Noun Phrase Vector Representations. In Proceedings of the 4th Workshop on Representation Learning for NLP (RepL4NLP-2019), pages 84–95, Florence, Italy. Association for Computational Linguistics.
Cite (Informal):
Composing Noun Phrase Vector Representations (Kalouli et al., RepL4NLP 2019)
Copy Citation:
PDF:
https://aclanthology.org/W19-4311.pdf