A Multi-Task Learning Framework for Extracting Bacteria Biotope Information

Qi Zhang, Chao Liu, Ying Chi, Xuansong Xie, Xiansheng Hua


Abstract
This paper presents a novel transfer multi-task learning method for Bacteria Biotope rel+ner task at BioNLP-OST 2019. To alleviate the data deficiency problem in domain-specific information extraction, we use BERT(Bidirectional Encoder Representations from Transformers) and pre-train it using mask language models and next sentence prediction on both general corpus and medical corpus like PubMed. In fine-tuning stage, we fine-tune the relation extraction layer and mention recognition layer designed by us on the top of BERT to extract mentions and relations simultaneously. The evaluation results show that our method achieves the best performance on all metrics (including slot error rate, precision and recall) in the Bacteria Biotope rel+ner subtask.
Anthology ID:
D19-5716
Volume:
Proceedings of the 5th Workshop on BioNLP Open Shared Tasks
Month:
November
Year:
2019
Address:
Hong Kong, China
Editors:
Kim Jin-Dong, Nédellec Claire, Bossy Robert, Deléger Louise
Venue:
BioNLP
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
105–109
Language:
URL:
https://aclanthology.org/D19-5716
DOI:
10.18653/v1/D19-5716
Bibkey:
Cite (ACL):
Qi Zhang, Chao Liu, Ying Chi, Xuansong Xie, and Xiansheng Hua. 2019. A Multi-Task Learning Framework for Extracting Bacteria Biotope Information. In Proceedings of the 5th Workshop on BioNLP Open Shared Tasks, pages 105–109, Hong Kong, China. Association for Computational Linguistics.
Cite (Informal):
A Multi-Task Learning Framework for Extracting Bacteria Biotope Information (Zhang et al., BioNLP 2019)
Copy Citation:
PDF:
https://aclanthology.org/D19-5716.pdf