%0 Conference Proceedings
%T RPD: A Distance Function Between Word Embeddings
%A Zhou, Xuhui
%A Huang, Shujian
%A Zheng, Zaixiang
%Y Rijhwani, Shruti
%Y Liu, Jiangming
%Y Wang, Yizhong
%Y Dror, Rotem
%S Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics: Student Research Workshop
%D 2020
%8 July
%I Association for Computational Linguistics
%C Online
%F zhou-etal-2020-rpd
%X It is well-understood that different algorithms, training processes, and corpora produce different word embeddings. However, less is known about the relation between different embedding spaces, i.e. how far different sets of em-beddings deviate from each other. In this paper, we propose a novel metric called Relative Pairwise Inner Product Distance (RPD) to quantify the distance between different sets of word embeddings. This unitary-invariant metric has a unified scale for comparing different sets of word embeddings. Based on the properties of RPD, we study the relations of word embeddings of different algorithms systematically and investigate the influence of different training processes and corpora. The results shed light on the poorly understood word embeddings and justify RPD as a measure of the distance of embedding space.
%R 10.18653/v1/2020.acl-srw.7
%U https://aclanthology.org/2020.acl-srw.7
%U https://doi.org/10.18653/v1/2020.acl-srw.7
%P 42-50