Multi-Relational Hyperbolic Word Embeddings from Natural Language Definitions

Marco Valentino, Danilo Carvalho, Andre Freitas


Abstract
Natural language definitions possess a recursive, self-explanatory semantic structure that can support representation learning methods able to preserve explicit conceptual relations and constraints in the latent space. This paper presents a multi-relational model that explicitly leverages such a structure to derive word embeddings from definitions. By automatically extracting the relations linking defined and defining terms from dictionaries, we demonstrate how the problem of learning word embeddings can be formalised via a translational framework in Hyperbolic space and used as a proxy to capture the global semantic structure of definitions. An extensive empirical analysis demonstrates that the framework can help imposing the desired structural constraints while preserving the semantic mapping required for controllable and interpretable traversal. Moreover, the experiments reveal the superiority of the Hyperbolic word embeddings over the Euclidean counterparts and demonstrate that the multi-relational approach can obtain competitive results when compared to state-of-the-art neural models, with the advantage of being intrinsically more efficient and interpretable
Anthology ID:
2024.eacl-long.2
Volume:
Proceedings of the 18th Conference of the European Chapter of the Association for Computational Linguistics (Volume 1: Long Papers)
Month:
March
Year:
2024
Address:
St. Julian’s, Malta
Editors:
Yvette Graham, Matthew Purver
Venue:
EACL
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
23–34
Language:
URL:
https://aclanthology.org/2024.eacl-long.2
DOI:
Bibkey:
Cite (ACL):
Marco Valentino, Danilo Carvalho, and Andre Freitas. 2024. Multi-Relational Hyperbolic Word Embeddings from Natural Language Definitions. In Proceedings of the 18th Conference of the European Chapter of the Association for Computational Linguistics (Volume 1: Long Papers), pages 23–34, St. Julian’s, Malta. Association for Computational Linguistics.
Cite (Informal):
Multi-Relational Hyperbolic Word Embeddings from Natural Language Definitions (Valentino et al., EACL 2024)
Copy Citation:
PDF:
https://aclanthology.org/2024.eacl-long.2.pdf
Software:
 2024.eacl-long.2.software.zip