Benchmark and Best Practices for Biomedical Knowledge Graph Embeddings

David Chang, Ivana Balažević, Carl Allen, Daniel Chawla, Cynthia Brandt, Andrew Taylor


Abstract
Much of biomedical and healthcare data is encoded in discrete, symbolic form such as text and medical codes. There is a wealth of expert-curated biomedical domain knowledge stored in knowledge bases and ontologies, but the lack of reliable methods for learning knowledge representation has limited their usefulness in machine learning applications. While text-based representation learning has significantly improved in recent years through advances in natural language processing, attempts to learn biomedical concept embeddings so far have been lacking. A recent family of models called knowledge graph embeddings have shown promising results on general domain knowledge graphs, and we explore their capabilities in the biomedical domain. We train several state-of-the-art knowledge graph embedding models on the SNOMED-CT knowledge graph, provide a benchmark with comparison to existing methods and in-depth discussion on best practices, and make a case for the importance of leveraging the multi-relational nature of knowledge graphs for learning biomedical knowledge representation. The embeddings, code, and materials will be made available to the community.
Anthology ID:
2020.bionlp-1.18
Volume:
Proceedings of the 19th SIGBioMed Workshop on Biomedical Language Processing
Month:
July
Year:
2020
Address:
Online
Editors:
Dina Demner-Fushman, Kevin Bretonnel Cohen, Sophia Ananiadou, Junichi Tsujii
Venue:
BioNLP
SIG:
SIGBIOMED
Publisher:
Association for Computational Linguistics
Note:
Pages:
167–176
Language:
URL:
https://aclanthology.org/2020.bionlp-1.18
DOI:
10.18653/v1/2020.bionlp-1.18
Bibkey:
Cite (ACL):
David Chang, Ivana Balažević, Carl Allen, Daniel Chawla, Cynthia Brandt, and Andrew Taylor. 2020. Benchmark and Best Practices for Biomedical Knowledge Graph Embeddings. In Proceedings of the 19th SIGBioMed Workshop on Biomedical Language Processing, pages 167–176, Online. Association for Computational Linguistics.
Cite (Informal):
Benchmark and Best Practices for Biomedical Knowledge Graph Embeddings (Chang et al., BioNLP 2020)
Copy Citation:
PDF:
https://aclanthology.org/2020.bionlp-1.18.pdf
Software:
 2020.bionlp-1.18.Software.zip
Code
 dchang56/snomed_kge
Data
IS-A