Improving Medical NLI Using Context-Aware Domain Knowledge

Shaika Chowdhury, Philip Yu, Yuan Luo


Abstract
Domain knowledge is important to understand both the lexical and relational associations of words in natural language text, especially for domain-specific tasks like Natural Language Inference (NLI) in the medical domain, where due to the lack of a large annotated dataset such knowledge cannot be implicitly learned during training. However, because of the linguistic idiosyncrasies of clinical texts (e.g., shorthand jargon), solely relying on domain knowledge from an external knowledge base (e.g., UMLS) can lead to wrong inference predictions as it disregards contextual information and, hence, does not return the most relevant mapping. To remedy this, we devise a knowledge adaptive approach for medical NLI that encodes the premise/hypothesis texts by leveraging supplementary external knowledge, alongside the UMLS, based on the word contexts. By incorporating refined domain knowledge at both the lexical and relational levels through a multi-source attention mechanism, it is able to align the token-level interactions between the premise and hypothesis more effectively. Comprehensive experiments and case study on the recently released MedNLI dataset are conducted to validate the effectiveness of the proposed approach.
Anthology ID:
2020.starsem-1.1
Volume:
Proceedings of the Ninth Joint Conference on Lexical and Computational Semantics
Month:
December
Year:
2020
Address:
Barcelona, Spain (Online)
Editors:
Iryna Gurevych, Marianna Apidianaki, Manaal Faruqui
Venue:
*SEM
SIG:
SIGLEX
Publisher:
Association for Computational Linguistics
Note:
Pages:
1–11
Language:
URL:
https://aclanthology.org/2020.starsem-1.1
DOI:
Bibkey:
Cite (ACL):
Shaika Chowdhury, Philip Yu, and Yuan Luo. 2020. Improving Medical NLI Using Context-Aware Domain Knowledge. In Proceedings of the Ninth Joint Conference on Lexical and Computational Semantics, pages 1–11, Barcelona, Spain (Online). Association for Computational Linguistics.
Cite (Informal):
Improving Medical NLI Using Context-Aware Domain Knowledge (Chowdhury et al., *SEM 2020)
Copy Citation:
PDF:
https://aclanthology.org/2020.starsem-1.1.pdf
Data
MIMIC-III