Box-To-Box Transformations for Modeling Joint Hierarchies
Shib
Sankar
Dasgupta
author
Xiang
Lorraine
Li
author
Michael
Boratko
author
Dongxu
Zhang
author
Andrew
McCallum
author
2021-08
text
Proceedings of the 6th Workshop on Representation Learning for NLP (RepL4NLP-2021)
Anna
Rogers
editor
Iacer
Calixto
editor
Ivan
Vulić
editor
Naomi
Saphra
editor
Nora
Kassner
editor
Oana-Maria
Camburu
editor
Trapit
Bansal
editor
Vered
Shwartz
editor
Association for Computational Linguistics
Online
conference publication
Learning representations of entities and relations in structured knowledge bases is an active area of research, with much emphasis placed on choosing the appropriate geometry to capture the hierarchical structures exploited in, for example, isa or haspart relations. Box embeddings (Vilnis et al., 2018; Li et al., 2019; Dasgupta et al., 2020), which represent concepts as n-dimensional hyperrectangles, are capable of embedding hierarchies when training on a subset of the transitive closure. In Patel et al., (2020), the authors demonstrate that only the transitive reduction is required and further extend box embeddings to capture joint hierarchies by augmenting the graph with new nodes. While it is possible to represent joint hierarchies with this method, the parameters for each hierarchy are decoupled, making generalization between hierarchies infeasible. In this work, we introduce a learned box-to-box transformation that respects the structure of each hierarchy. We demonstrate that this not only improves the capability of modeling cross-hierarchy compositional edges but is also capable of generalizing from a subset of the transitive reduction.
dasgupta-etal-2021-box
10.18653/v1/2021.repl4nlp-1.28
https://aclanthology.org/2021.repl4nlp-1.28
2021-08
277
288