Evaluating Ways of Adapting Word Similarity

Libby Barak, Adele Goldberg


Abstract
People judge pairwise similarity by deciding which aspects of the words’ meanings are relevant for the comparison of the given pair. However, computational representations of meaning rely on dimensions of the vector representation for similarity comparisons, without considering the specific pairing at hand. Prior work has adapted computational similarity judgments by using the softmax function in order to address this limitation by capturing asymmetry in human judgments. We extend this analysis by showing that a simple modification of cosine similarity offers a better correlation with human judgments over a comprehensive dataset. The modification performs best when the similarity between two words is calculated with reference to other words that are most similar and dissimilar to the pair.
Anthology ID:
W19-3639
Volume:
Proceedings of the 2019 Workshop on Widening NLP
Month:
August
Year:
2019
Address:
Florence, Italy
Editors:
Amittai Axelrod, Diyi Yang, Rossana Cunha, Samira Shaikh, Zeerak Waseem
Venue:
WiNLP
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
126–128
Language:
URL:
https://aclanthology.org/W19-3639
DOI:
Bibkey:
Cite (ACL):
Libby Barak and Adele Goldberg. 2019. Evaluating Ways of Adapting Word Similarity. In Proceedings of the 2019 Workshop on Widening NLP, pages 126–128, Florence, Italy. Association for Computational Linguistics.
Cite (Informal):
Evaluating Ways of Adapting Word Similarity (Barak & Goldberg, WiNLP 2019)
Copy Citation: