Stanford MLab at SemEval 2023 Task 7: Neural Methods for Clinical Trial Report NLI

Conner Takehana, Dylan Lim, Emirhan Kurtulus, Ramya Iyer, Ellie Tanimura, Pankhuri Aggarwal, Molly Cantillon, Alfred Yu, Sarosh Khan, Nathan Chi


Abstract
We present a system for natural language inference in breast cancer clinical trial reports, as framed by SemEval 2023 Task 7: Multi-evidence Natural Language Inference for Clinical Trial Data. In particular, we propose a suite of techniques for two related inference subtasks: entailment and evidence retrieval. The purpose of the textual entailment identification subtask is to determine the inference relation (either entailment or contradiction) between given statement pairs, while the goal of the evidence retrieval task is to identify a set of sentences that support this inference relation. To this end, we propose fine-tuning Bio+Clinical BERT, a BERT-based model pre-trained on clinical data. Along with presenting our system, we analyze our architectural decisions in the context of our model’s accuracy and conduct an error analysis. Overall, our system ranked 20 / 30 on the entailment subtask.
Anthology ID:
2023.semeval-1.245
Volume:
Proceedings of the 17th International Workshop on Semantic Evaluation (SemEval-2023)
Month:
July
Year:
2023
Address:
Toronto, Canada
Editors:
Atul Kr. Ojha, A. Seza Doğruöz, Giovanni Da San Martino, Harish Tayyar Madabushi, Ritesh Kumar, Elisa Sartori
Venue:
SemEval
SIG:
SIGLEX
Publisher:
Association for Computational Linguistics
Note:
Pages:
1769–1775
Language:
URL:
https://aclanthology.org/2023.semeval-1.245
DOI:
10.18653/v1/2023.semeval-1.245
Bibkey:
Cite (ACL):
Conner Takehana, Dylan Lim, Emirhan Kurtulus, Ramya Iyer, Ellie Tanimura, Pankhuri Aggarwal, Molly Cantillon, Alfred Yu, Sarosh Khan, and Nathan Chi. 2023. Stanford MLab at SemEval 2023 Task 7: Neural Methods for Clinical Trial Report NLI. In Proceedings of the 17th International Workshop on Semantic Evaluation (SemEval-2023), pages 1769–1775, Toronto, Canada. Association for Computational Linguistics.
Cite (Informal):
Stanford MLab at SemEval 2023 Task 7: Neural Methods for Clinical Trial Report NLI (Takehana et al., SemEval 2023)
Copy Citation:
PDF:
https://aclanthology.org/2023.semeval-1.245.pdf