Derivational Morphological Relations in Word Embeddings

Tomáš Musil, Jonáš Vidra, David Mareček


Abstract
Derivation is a type of a word-formation process which creates new words from existing ones by adding, changing or deleting affixes. In this paper, we explore the potential of word embeddings to identify properties of word derivations in the morphologically rich Czech language. We extract derivational relations between pairs of words from DeriNet, a Czech lexical network, which organizes almost one million Czech lemmas into derivational trees. For each such pair, we compute the difference of the embeddings of the two words, and perform unsupervised clustering of the resulting vectors. Our results show that these clusters largely match manually annotated semantic categories of the derivational relations (e.g. the relation ‘bake–baker’ belongs to category ‘actor’, and a correct clustering puts it into the same cluster as ‘govern–governor’).
Anthology ID:
W19-4818
Volume:
Proceedings of the 2019 ACL Workshop BlackboxNLP: Analyzing and Interpreting Neural Networks for NLP
Month:
August
Year:
2019
Address:
Florence, Italy
Editors:
Tal Linzen, Grzegorz Chrupała, Yonatan Belinkov, Dieuwke Hupkes
Venue:
BlackboxNLP
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
173–180
Language:
URL:
https://aclanthology.org/W19-4818
DOI:
10.18653/v1/W19-4818
Bibkey:
Cite (ACL):
Tomáš Musil, Jonáš Vidra, and David Mareček. 2019. Derivational Morphological Relations in Word Embeddings. In Proceedings of the 2019 ACL Workshop BlackboxNLP: Analyzing and Interpreting Neural Networks for NLP, pages 173–180, Florence, Italy. Association for Computational Linguistics.
Cite (Informal):
Derivational Morphological Relations in Word Embeddings (Musil et al., BlackboxNLP 2019)
Copy Citation:
PDF:
https://aclanthology.org/W19-4818.pdf