A Fully Hyperbolic Neural Model for Hierarchical Multi-Class Classification

Federico López, Michael Strube


Abstract
Label inventories for fine-grained entity typing have grown in size and complexity. Nonetheless, they exhibit a hierarchical structure. Hyperbolic spaces offer a mathematically appealing approach for learning hierarchical representations of symbolic data. However, it is not clear how to integrate hyperbolic components into downstream tasks. This is the first work that proposes a fully hyperbolic model for multi-class multi-label classification, which performs all operations in hyperbolic space. We evaluate the proposed model on two challenging datasets and compare to different baselines that operate under Euclidean assumptions. Our hyperbolic model infers the latent hierarchy from the class distribution, captures implicit hyponymic relations in the inventory, and shows performance on par with state-of-the-art methods on fine-grained classification with remarkable reduction of the parameter size. A thorough analysis sheds light on the impact of each component in the final prediction and showcases its ease of integration with Euclidean layers.
Anthology ID:
2020.findings-emnlp.42
Volume:
Findings of the Association for Computational Linguistics: EMNLP 2020
Month:
November
Year:
2020
Address:
Online
Editors:
Trevor Cohn, Yulan He, Yang Liu
Venue:
Findings
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
460–475
Language:
URL:
https://aclanthology.org/2020.findings-emnlp.42
DOI:
10.18653/v1/2020.findings-emnlp.42
Bibkey:
Cite (ACL):
Federico López and Michael Strube. 2020. A Fully Hyperbolic Neural Model for Hierarchical Multi-Class Classification. In Findings of the Association for Computational Linguistics: EMNLP 2020, pages 460–475, Online. Association for Computational Linguistics.
Cite (Informal):
A Fully Hyperbolic Neural Model for Hierarchical Multi-Class Classification (López & Strube, Findings 2020)
Copy Citation:
PDF:
https://aclanthology.org/2020.findings-emnlp.42.pdf
Video:
 https://slideslive.com/38940646
Code
 nlpAThits/hyfi