CylE: Cylinder Embeddings for Multi-hop Reasoning over Knowledge Graphs

Chau Duc Minh Nguyen, Tim French, Wei Liu, Michael Stewart


Abstract
Recent geometric-based approaches have been shown to efficiently model complex logical queries (including the intersection operation) over Knowledge Graphs based on the natural representation of Venn diagram. Existing geometric-based models (using points, boxes embeddings), however, cannot handle the logical negation operation. Further, those using cones embeddings are limited to representing queries by two-dimensional shapes, which reduced their effectiveness in capturing entities query relations for correct answers. To overcome this challenge, we propose unbounded cylinder embeddings (namely CylE), which is a novel geometric-based model based on three-dimensional shapes. Our approach can handle a complete set of basic first-order logic operations (conjunctions, disjunctions and negations). CylE considers queries as Cartesian products of unbounded sector-cylinders and consider a set of nearest boxes corresponds to the set of answer entities. Precisely, the conjunctions can be represented via the intersections of unbounded sector-cylinders. Transforming queries to Disjunctive Normal Form can handle queries with disjunctions. The negations can be represented by considering the closure of complement for an arbitrary unbounded sector-cylinder. Empirical results show that the performance of multi-hop reasoning task using CylE significantly increases over state-of-the-art geometric-based query embedding models for queries without negation. For queries with negation operations, though the performance is on a par with the best performing geometric-based model, CylE significantly outperforms a recent distribution-based model.
Anthology ID:
2023.eacl-main.127
Volume:
Proceedings of the 17th Conference of the European Chapter of the Association for Computational Linguistics
Month:
May
Year:
2023
Address:
Dubrovnik, Croatia
Editors:
Andreas Vlachos, Isabelle Augenstein
Venue:
EACL
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
1736–1751
Language:
URL:
https://aclanthology.org/2023.eacl-main.127
DOI:
10.18653/v1/2023.eacl-main.127
Bibkey:
Cite (ACL):
Chau Duc Minh Nguyen, Tim French, Wei Liu, and Michael Stewart. 2023. CylE: Cylinder Embeddings for Multi-hop Reasoning over Knowledge Graphs. In Proceedings of the 17th Conference of the European Chapter of the Association for Computational Linguistics, pages 1736–1751, Dubrovnik, Croatia. Association for Computational Linguistics.
Cite (Informal):
CylE: Cylinder Embeddings for Multi-hop Reasoning over Knowledge Graphs (Nguyen et al., EACL 2023)
Copy Citation:
PDF:
https://aclanthology.org/2023.eacl-main.127.pdf
Video:
 https://aclanthology.org/2023.eacl-main.127.mp4