Outta Control: Laws of Semantic Change and Inherent Biases in Word Representation Models

Haim Dubossarsky, Daphna Weinshall, Eitan Grossman


Abstract
This article evaluates three proposed laws of semantic change. Our claim is that in order to validate a putative law of semantic change, the effect should be observed in the genuine condition but absent or reduced in a suitably matched control condition, in which no change can possibly have taken place. Our analysis shows that the effects reported in recent literature must be substantially revised: (i) the proposed negative correlation between meaning change and word frequency is shown to be largely an artefact of the models of word representation used; (ii) the proposed negative correlation between meaning change and prototypicality is shown to be much weaker than what has been claimed in prior art; and (iii) the proposed positive correlation between meaning change and polysemy is largely an artefact of word frequency. These empirical observations are corroborated by analytical proofs that show that count representations introduce an inherent dependence on word frequency, and thus word frequency cannot be evaluated as an independent factor with these representations.
Anthology ID:
D17-1118
Volume:
Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing
Month:
September
Year:
2017
Address:
Copenhagen, Denmark
Editors:
Martha Palmer, Rebecca Hwa, Sebastian Riedel
Venue:
EMNLP
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
1136–1145
Language:
URL:
https://aclanthology.org/D17-1118
DOI:
10.18653/v1/D17-1118
Bibkey:
Cite (ACL):
Haim Dubossarsky, Daphna Weinshall, and Eitan Grossman. 2017. Outta Control: Laws of Semantic Change and Inherent Biases in Word Representation Models. In Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing, pages 1136–1145, Copenhagen, Denmark. Association for Computational Linguistics.
Cite (Informal):
Outta Control: Laws of Semantic Change and Inherent Biases in Word Representation Models (Dubossarsky et al., EMNLP 2017)
Copy Citation:
PDF:
https://aclanthology.org/D17-1118.pdf
Video:
 https://aclanthology.org/D17-1118.mp4