Can Large Language Models Enhance Predictions of Disease Progression? Investigating Through Disease Network Link Prediction

Haohui Lu, Usman Naseem


Abstract
Large Language Models (LLMs) have made significant strides in various tasks, yet their effectiveness in predicting disease progression remains relatively unexplored. To fill this gap, we use LLMs and employ advanced graph prompting and Retrieval-Augmented Generation (RAG) to predict disease comorbidity within disease networks. Specifically, we introduce a disease Comorbidity prediction model using LLM, named ComLLM, which leverages domain knowledge to enhance the prediction performance. Based on the comprehensive experimental results, ComLLM consistently outperforms conventional models, such as Graph Neural Networks, achieving average area under the curve (AUC) improvements of 10.70% and 6.07% over the best baseline models in two distinct disease networks. ComLLM is evaluated across multiple settings for disease progression prediction, employing various prompting strategies, including zero-shot, few-shot, Chain-of-Thought, graph prompting and RAG. Our results show that graph prompting and RAG enhance LLM performance in disease progression prediction tasks. ComLLM exhibits superior predictive capabilities and serves as a proof-of-concept for LLM-based systems in disease progression prediction, highlighting its potential for broad applications in healthcare.
Anthology ID:
2024.emnlp-main.980
Volume:
Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing
Month:
November
Year:
2024
Address:
Miami, Florida, USA
Editors:
Yaser Al-Onaizan, Mohit Bansal, Yun-Nung Chen
Venue:
EMNLP
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
17703–17715
Language:
URL:
https://aclanthology.org/2024.emnlp-main.980
DOI:
Bibkey:
Cite (ACL):
Haohui Lu and Usman Naseem. 2024. Can Large Language Models Enhance Predictions of Disease Progression? Investigating Through Disease Network Link Prediction. In Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing, pages 17703–17715, Miami, Florida, USA. Association for Computational Linguistics.
Cite (Informal):
Can Large Language Models Enhance Predictions of Disease Progression? Investigating Through Disease Network Link Prediction (Lu & Naseem, EMNLP 2024)
Copy Citation:
PDF:
https://aclanthology.org/2024.emnlp-main.980.pdf