CARE: Extracting Experimental Findings From Clinical Literature

Aakanksha Naik, Bailey Kuehl, Erin Bransom, Doug Downey, Tom Hope


Abstract
Extracting fine-grained experimental findings from literature can provide dramatic utility for scientific applications. Prior work has developed annotation schemas and datasets for limited aspects of this problem, failing to capture the real-world complexity and nuance required. Focusing on biomedicine, this work presents CARE—a new IE dataset for the task of extracting clinical findings. We develop a new annotation schema capturing fine-grained findings as n-ary relations between entities and attributes, which unifies phenomena challenging for current IE systems such as discontinuous entity spans, nested relations, variable arity n-ary relations and numeric results in a single schema. We collect extensive annotations for 700 abstracts from two sources: clinical trials and case reports. We also demonstrate the generalizability of our schema to the computer science and materials science domains. We benchmark state-of-the-art IE systems on CARE, showing that even models such as GPT4 struggle. We release our resources to advance research on extracting and aggregating literature findings.
Anthology ID:
2024.findings-naacl.285
Volume:
Findings of the Association for Computational Linguistics: NAACL 2024
Month:
June
Year:
2024
Address:
Mexico City, Mexico
Editors:
Kevin Duh, Helena Gomez, Steven Bethard
Venue:
Findings
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
4580–4596
Language:
URL:
https://aclanthology.org/2024.findings-naacl.285
DOI:
Bibkey:
Cite (ACL):
Aakanksha Naik, Bailey Kuehl, Erin Bransom, Doug Downey, and Tom Hope. 2024. CARE: Extracting Experimental Findings From Clinical Literature. In Findings of the Association for Computational Linguistics: NAACL 2024, pages 4580–4596, Mexico City, Mexico. Association for Computational Linguistics.
Cite (Informal):
CARE: Extracting Experimental Findings From Clinical Literature (Naik et al., Findings 2024)
Copy Citation:
PDF:
https://aclanthology.org/2024.findings-naacl.285.pdf
Copyright:
 2024.findings-naacl.285.copyright.pdf