NADE: A Benchmark for Robust Adverse Drug Events Extraction in Face of Negations

Simone Scaboro, Beatrice Portelli, Emmanuele Chersoni, Enrico Santus, Giuseppe Serra


Abstract
Adverse Drug Event (ADE) extraction models can rapidly examine large collections of social media texts, detecting mentions of drug-related adverse reactions and trigger medical investigations. However, despite the recent advances in NLP, it is currently unknown if such models are robust in face of negation, which is pervasive across language varieties. In this paper we evaluate three state-of-the-art systems, showing their fragility against negation, and then we introduce two possible strategies to increase the robustness of these models: a pipeline approach, relying on a specific component for negation detection; an augmentation of an ADE extraction dataset to artificially create negated samples and further train the models. We show that both strategies bring significant increases in performance, lowering the number of spurious entities predicted by the models. Our dataset and code will be publicly released to encourage research on the topic.
Anthology ID:
2021.wnut-1.26
Volume:
Proceedings of the Seventh Workshop on Noisy User-generated Text (W-NUT 2021)
Month:
November
Year:
2021
Address:
Online
Editors:
Wei Xu, Alan Ritter, Tim Baldwin, Afshin Rahimi
Venue:
WNUT
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
230–237
Language:
URL:
https://aclanthology.org/2021.wnut-1.26
DOI:
10.18653/v1/2021.wnut-1.26
Bibkey:
Cite (ACL):
Simone Scaboro, Beatrice Portelli, Emmanuele Chersoni, Enrico Santus, and Giuseppe Serra. 2021. NADE: A Benchmark for Robust Adverse Drug Events Extraction in Face of Negations. In Proceedings of the Seventh Workshop on Noisy User-generated Text (W-NUT 2021), pages 230–237, Online. Association for Computational Linguistics.
Cite (Informal):
NADE: A Benchmark for Robust Adverse Drug Events Extraction in Face of Negations (Scaboro et al., WNUT 2021)
Copy Citation:
PDF:
https://aclanthology.org/2021.wnut-1.26.pdf
Software:
 2021.wnut-1.26.Software.zip
Code
 ailabudinegit/nade-dataset
Data
SMM4H