Comparing Euclidean and Hyperbolic Embeddings on the WordNet Nouns Hypernymy Graph

Sameer Bansal, Adrian Benton


Abstract
Nickel and Kiela (2017) present a new method for embedding tree nodes in the Poincare ball, and suggest that these hyperbolic embeddings are far more effective than Euclidean embeddings at embedding nodes in large, hierarchically structured graphs like the WordNet nouns hypernymy tree. This is especially true in low dimensions (Nickel and Kiela, 2017, Table 1). In this work, we seek to reproduce their experiments on embedding and reconstructing the WordNet nouns hypernymy graph. Counter to what they report, we find that Euclidean embeddings are able to represent this tree at least as well as Poincare embeddings, when allowed at least 50 dimensions. We note that this does not diminish the significance of their work given the impressive performance of hyperbolic embeddings in very low-dimensional settings. However, given the wide influence of their work, our aim here is to present an updated and more accurate comparison between the Euclidean and hyperbolic embeddings.
Anthology ID:
2021.insights-1.8
Volume:
Proceedings of the Second Workshop on Insights from Negative Results in NLP
Month:
November
Year:
2021
Address:
Online and Punta Cana, Dominican Republic
Editors:
João Sedoc, Anna Rogers, Anna Rumshisky, Shabnam Tafreshi
Venue:
insights
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
49–53
Language:
URL:
https://aclanthology.org/2021.insights-1.8
DOI:
10.18653/v1/2021.insights-1.8
Bibkey:
Cite (ACL):
Sameer Bansal and Adrian Benton. 2021. Comparing Euclidean and Hyperbolic Embeddings on the WordNet Nouns Hypernymy Graph. In Proceedings of the Second Workshop on Insights from Negative Results in NLP, pages 49–53, Online and Punta Cana, Dominican Republic. Association for Computational Linguistics.
Cite (Informal):
Comparing Euclidean and Hyperbolic Embeddings on the WordNet Nouns Hypernymy Graph (Bansal & Benton, insights 2021)
Copy Citation:
PDF:
https://aclanthology.org/2021.insights-1.8.pdf
Video:
 https://aclanthology.org/2021.insights-1.8.mp4