Fine-Grained Entity Typing in Hyperbolic Space

Federico López, Benjamin Heinzerling, Michael Strube


Abstract
How can we represent hierarchical information present in large type inventories for entity typing? We study the suitability of hyperbolic embeddings to capture hierarchical relations between mentions in context and their target types in a shared vector space. We evaluate on two datasets and propose two different techniques to extract hierarchical information from the type inventory: from an expert-generated ontology and by automatically mining the dataset. The hyperbolic model shows improvements in some but not all cases over its Euclidean counterpart. Our analysis suggests that the adequacy of this geometry depends on the granularity of the type inventory and the representation of its distribution.
Anthology ID:
W19-4319
Volume:
Proceedings of the 4th Workshop on Representation Learning for NLP (RepL4NLP-2019)
Month:
August
Year:
2019
Address:
Florence, Italy
Editors:
Isabelle Augenstein, Spandana Gella, Sebastian Ruder, Katharina Kann, Burcu Can, Johannes Welbl, Alexis Conneau, Xiang Ren, Marek Rei
Venue:
RepL4NLP
SIG:
SIGREP
Publisher:
Association for Computational Linguistics
Note:
Pages:
169–180
Language:
URL:
https://aclanthology.org/W19-4319
DOI:
10.18653/v1/W19-4319
Bibkey:
Cite (ACL):
Federico López, Benjamin Heinzerling, and Michael Strube. 2019. Fine-Grained Entity Typing in Hyperbolic Space. In Proceedings of the 4th Workshop on Representation Learning for NLP (RepL4NLP-2019), pages 169–180, Florence, Italy. Association for Computational Linguistics.
Cite (Informal):
Fine-Grained Entity Typing in Hyperbolic Space (López et al., RepL4NLP 2019)
Copy Citation:
PDF:
https://aclanthology.org/W19-4319.pdf
Code
 nlpAThits/figet-hyperbolic-space