Predicting Clinical Trial Results by Implicit Evidence Integration

Qiao Jin, Chuanqi Tan, Mosha Chen, Xiaozhong Liu, Songfang Huang


Abstract
Clinical trials provide essential guidance for practicing Evidence-Based Medicine, though often accompanying with unendurable costs and risks. To optimize the design of clinical trials, we introduce a novel Clinical Trial Result Prediction (CTRP) task. In the CTRP framework, a model takes a PICO-formatted clinical trial proposal with its background as input and predicts the result, i.e. how the Intervention group compares with the Comparison group in terms of the measured Outcome in the studied Population. While structured clinical evidence is prohibitively expensive for manual collection, we exploit large-scale unstructured sentences from medical literature that implicitly contain PICOs and results as evidence. Specifically, we pre-train a model to predict the disentangled results from such implicit evidence and fine-tune the model with limited data on the downstream datasets. Experiments on the benchmark Evidence Integration dataset show that the proposed model outperforms the baselines by large margins, e.g., with a 10.7% relative gain over BioBERT in macro-F1. Moreover, the performance improvement is also validated on another dataset composed of clinical trials related to COVID-19.
Anthology ID:
2020.emnlp-main.114
Volume:
Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP)
Month:
November
Year:
2020
Address:
Online
Editors:
Bonnie Webber, Trevor Cohn, Yulan He, Yang Liu
Venue:
EMNLP
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
1461–1477
Language:
URL:
https://aclanthology.org/2020.emnlp-main.114
DOI:
10.18653/v1/2020.emnlp-main.114
Bibkey:
Cite (ACL):
Qiao Jin, Chuanqi Tan, Mosha Chen, Xiaozhong Liu, and Songfang Huang. 2020. Predicting Clinical Trial Results by Implicit Evidence Integration. In Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP), pages 1461–1477, Online. Association for Computational Linguistics.
Cite (Informal):
Predicting Clinical Trial Results by Implicit Evidence Integration (Jin et al., EMNLP 2020)
Copy Citation:
PDF:
https://aclanthology.org/2020.emnlp-main.114.pdf
Video:
 https://slideslive.com/38939008
Code
 Alibaba-NLP/EBM-Net
Data
Evidence Inference