BiQUE: Biquaternionic Embeddings of Knowledge Graphs

Jia Guo, Stanley Kok


Abstract
Knowledge graph embeddings (KGEs) compactly encode multi-relational knowledge graphs (KGs). Existing KGE models rely on geometric operations to model relational patterns. Euclidean (circular) rotation is useful for modeling patterns such as symmetry, but cannot represent hierarchical semantics. In contrast, hyperbolic models are effective at modeling hierarchical relations, but do not perform as well on patterns on which circular rotation excels. It is crucial for KGE models to unify multiple geometric transformations so as to fully cover the multifarious relations in KGs. To do so, we propose BiQUE, a novel model that employs biquaternions to integrate multiple geometric transformations, viz., scaling, translation, Euclidean rotation, and hyperbolic rotation. BiQUE makes the best trade-offs among geometric operators during training, picking the best one (or their best combination) for each relation. Experiments on five datasets show BiQUE’s effectiveness.
Anthology ID:
2021.emnlp-main.657
Volume:
Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing
Month:
November
Year:
2021
Address:
Online and Punta Cana, Dominican Republic
Editors:
Marie-Francine Moens, Xuanjing Huang, Lucia Specia, Scott Wen-tau Yih
Venue:
EMNLP
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
8338–8351
Language:
URL:
https://aclanthology.org/2021.emnlp-main.657
DOI:
10.18653/v1/2021.emnlp-main.657
Bibkey:
Cite (ACL):
Jia Guo and Stanley Kok. 2021. BiQUE: Biquaternionic Embeddings of Knowledge Graphs. In Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing, pages 8338–8351, Online and Punta Cana, Dominican Republic. Association for Computational Linguistics.
Cite (Informal):
BiQUE: Biquaternionic Embeddings of Knowledge Graphs (Guo & Kok, EMNLP 2021)
Copy Citation:
PDF:
https://aclanthology.org/2021.emnlp-main.657.pdf
Software:
 2021.emnlp-main.657.Software.zip
Video:
 https://aclanthology.org/2021.emnlp-main.657.mp4
Code
 guojiapub/bique
Data
FB15k-237