NLNDE: Enhancing Neural Sequence Taggers with Attention and Noisy Channel for Robust Pharmacological Entity Detection

Lukas Lange, Heike Adel, Jannik Strötgen


Abstract
Named entity recognition has been extensively studied on English news texts. However, the transfer to other domains and languages is still a challenging problem. In this paper, we describe the system with which we participated in the first subtrack of the PharmaCoNER competition of the BioNLP Open Shared Tasks 2019. Aiming at pharmacological entity detection in Spanish texts, the task provides a non-standard domain and language setting. However, we propose an architecture that requires neither language nor domain expertise. We treat the task as a sequence labeling task and experiment with attention-based embedding selection and the training on automatically annotated data to further improve our system’s performance. Our system achieves promising results, especially by combining the different techniques, and reaches up to 88.6% F1 in the competition.
Anthology ID:
D19-5705
Volume:
Proceedings of the 5th Workshop on BioNLP Open Shared Tasks
Month:
November
Year:
2019
Address:
Hong Kong, China
Editors:
Kim Jin-Dong, Nédellec Claire, Bossy Robert, Deléger Louise
Venue:
BioNLP
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
26–32
Language:
URL:
https://aclanthology.org/D19-5705
DOI:
10.18653/v1/D19-5705
Bibkey:
Cite (ACL):
Lukas Lange, Heike Adel, and Jannik Strötgen. 2019. NLNDE: Enhancing Neural Sequence Taggers with Attention and Noisy Channel for Robust Pharmacological Entity Detection. In Proceedings of the 5th Workshop on BioNLP Open Shared Tasks, pages 26–32, Hong Kong, China. Association for Computational Linguistics.
Cite (Informal):
NLNDE: Enhancing Neural Sequence Taggers with Attention and Noisy Channel for Robust Pharmacological Entity Detection (Lange et al., BioNLP 2019)
Copy Citation:
PDF:
https://aclanthology.org/D19-5705.pdf