Assessing the Limits of the Distributional Hypothesis in Semantic Spaces: Trait-based Relational Knowledge and the Impact of Co-occurrences

Mark Anderson, Jose Camacho-collados


Abstract
The increase in performance in NLP due to the prevalence of distributional models and deep learning has brought with it a reciprocal decrease in interpretability. This has spurred a focus on what neural networks learn about natural language with less of a focus on how. Some work has focused on the data used to develop data-driven models, but typically this line of work aims to highlight issues with the data, e.g. highlighting and offsetting harmful biases. This work contributes to the relatively untrodden path of what is required in data for models to capture meaningful representations of natural language. This is entails evaluating how well English and Spanish semantic spaces capture a particular type of relational knowledge, namely the traits associated with concepts (e.g. bananas-yellow), and exploring the role of co-occurrences in this context.
Anthology ID:
2022.starsem-1.15
Volume:
Proceedings of the 11th Joint Conference on Lexical and Computational Semantics
Month:
July
Year:
2022
Address:
Seattle, Washington
Editors:
Vivi Nastase, Ellie Pavlick, Mohammad Taher Pilehvar, Jose Camacho-Collados, Alessandro Raganato
Venue:
*SEM
SIG:
SIGLEX
Publisher:
Association for Computational Linguistics
Note:
Pages:
173–185
Language:
URL:
https://aclanthology.org/2022.starsem-1.15
DOI:
10.18653/v1/2022.starsem-1.15
Bibkey:
Cite (ACL):
Mark Anderson and Jose Camacho-collados. 2022. Assessing the Limits of the Distributional Hypothesis in Semantic Spaces: Trait-based Relational Knowledge and the Impact of Co-occurrences. In Proceedings of the 11th Joint Conference on Lexical and Computational Semantics, pages 173–185, Seattle, Washington. Association for Computational Linguistics.
Cite (Informal):
Assessing the Limits of the Distributional Hypothesis in Semantic Spaces: Trait-based Relational Knowledge and the Impact of Co-occurrences (Anderson & Camacho-collados, *SEM 2022)
Copy Citation:
PDF:
https://aclanthology.org/2022.starsem-1.15.pdf
Code
 cardiffnlp/trait-relations-and-co-occurrences