Patient Outcome and Zero-shot Diagnosis Prediction with Hypernetwork-guided Multitask Learning

Shaoxiong Ji, Pekka Marttinen


Abstract
Multitask deep learning has been applied to patient outcome prediction from text, taking clinical notes as input and training deep neural networks with a joint loss function of multiple tasks. However, the joint training scheme of multitask learning suffers from inter-task interference, and diagnosis prediction among the multiple tasks has the generalizability issue due to rare diseases or unseen diagnoses. To solve these challenges, we propose a hypernetwork-based approach that generates task-conditioned parameters and coefficients of multitask prediction heads to learn task-specific prediction and balance the multitask learning. We also incorporate semantic task information to improve the generalizability of our task-conditioned multitask model. Experiments on early and discharge notes extracted from the real-world MIMIC database show our method can achieve better performance on multitask patient outcome prediction than strong baselines in most cases. Besides, our method can effectively handle the scenario with limited information and improve zero-shot prediction on unseen diagnosis categories.
Anthology ID:
2023.eacl-main.43
Volume:
Proceedings of the 17th Conference of the European Chapter of the Association for Computational Linguistics
Month:
May
Year:
2023
Address:
Dubrovnik, Croatia
Editors:
Andreas Vlachos, Isabelle Augenstein
Venue:
EACL
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
589–598
Language:
URL:
https://aclanthology.org/2023.eacl-main.43
DOI:
10.18653/v1/2023.eacl-main.43
Bibkey:
Cite (ACL):
Shaoxiong Ji and Pekka Marttinen. 2023. Patient Outcome and Zero-shot Diagnosis Prediction with Hypernetwork-guided Multitask Learning. In Proceedings of the 17th Conference of the European Chapter of the Association for Computational Linguistics, pages 589–598, Dubrovnik, Croatia. Association for Computational Linguistics.
Cite (Informal):
Patient Outcome and Zero-shot Diagnosis Prediction with Hypernetwork-guided Multitask Learning (Ji & Marttinen, EACL 2023)
Copy Citation:
PDF:
https://aclanthology.org/2023.eacl-main.43.pdf
Video:
 https://aclanthology.org/2023.eacl-main.43.mp4