<?xml version="1.0" encoding="UTF-8"?>
<modsCollection xmlns="http://www.loc.gov/mods/v3">
<mods ID="sun-yang-2019-transfer">
    <titleInfo>
        <title>Transfer Learning in Biomedical Named Entity Recognition: An Evaluation of BERT in the PharmaCoNER task</title>
    </titleInfo>
    <name type="personal">
        <namePart type="given">Cong</namePart>
        <namePart type="family">Sun</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">Zhihao</namePart>
        <namePart type="family">Yang</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <originInfo>
        <dateIssued>2019-11</dateIssued>
    </originInfo>
    <typeOfResource>text</typeOfResource>
    <relatedItem type="host">
        <titleInfo>
            <title>Proceedings of the 5th Workshop on BioNLP Open Shared Tasks</title>
        </titleInfo>
        <name type="personal">
            <namePart type="given">Kim</namePart>
            <namePart type="family">Jin-Dong</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Nédellec</namePart>
            <namePart type="family">Claire</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Bossy</namePart>
            <namePart type="family">Robert</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Deléger</namePart>
            <namePart type="family">Louise</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <originInfo>
            <publisher>Association for Computational Linguistics</publisher>
            <place>
                <placeTerm type="text">Hong Kong, China</placeTerm>
            </place>
        </originInfo>
        <genre authority="marcgt">conference publication</genre>
    </relatedItem>
    <abstract>To date, a large amount of biomedical content has been published in non-English texts, especially for clinical documents. Therefore, it is of considerable significance to conduct Natural Language Processing (NLP) research in non-English literature. PharmaCoNER is the first Named Entity Recognition (NER) task to recognize chemical and protein entities from Spanish biomedical texts. Since there have been abundant resources in the NLP field, how to exploit these existing resources to a new task to obtain competitive performance is a meaningful study. Inspired by the success of transfer learning with language models, we introduce the BERT benchmark to facilitate the research of PharmaCoNER task. In this paper, we evaluate two baselines based on Multilingual BERT and BioBERT on the PharmaCoNER corpus. Experimental results show that transferring the knowledge learned from source large-scale datasets to the target domain offers an effective solution for the PharmaCoNER task.</abstract>
    <identifier type="citekey">sun-yang-2019-transfer</identifier>
    <identifier type="doi">10.18653/v1/D19-5715</identifier>
    <location>
        <url>https://aclanthology.org/D19-5715</url>
    </location>
    <part>
        <date>2019-11</date>
        <extent unit="page">
            <start>100</start>
            <end>104</end>
        </extent>
    </part>
</mods>
</modsCollection>

%0 Conference Proceedings
%T Transfer Learning in Biomedical Named Entity Recognition: An Evaluation of BERT in the PharmaCoNER task
%A Sun, Cong
%A Yang, Zhihao
%Y Jin-Dong, Kim
%Y Claire, Nédellec
%Y Robert, Bossy
%Y Louise, Deléger
%S Proceedings of the 5th Workshop on BioNLP Open Shared Tasks
%D 2019
%8 November
%I Association for Computational Linguistics
%C Hong Kong, China
%F sun-yang-2019-transfer
%X To date, a large amount of biomedical content has been published in non-English texts, especially for clinical documents. Therefore, it is of considerable significance to conduct Natural Language Processing (NLP) research in non-English literature. PharmaCoNER is the first Named Entity Recognition (NER) task to recognize chemical and protein entities from Spanish biomedical texts. Since there have been abundant resources in the NLP field, how to exploit these existing resources to a new task to obtain competitive performance is a meaningful study. Inspired by the success of transfer learning with language models, we introduce the BERT benchmark to facilitate the research of PharmaCoNER task. In this paper, we evaluate two baselines based on Multilingual BERT and BioBERT on the PharmaCoNER corpus. Experimental results show that transferring the knowledge learned from source large-scale datasets to the target domain offers an effective solution for the PharmaCoNER task.
%R 10.18653/v1/D19-5715
%U https://aclanthology.org/D19-5715
%U https://doi.org/10.18653/v1/D19-5715
%P 100-104

Markdown (Informal)

[Transfer Learning in Biomedical Named Entity Recognition: An Evaluation of BERT in the PharmaCoNER task](https://aclanthology.org/D19-5715) (Sun & Yang, BioNLP 2019)

• Transfer Learning in Biomedical Named Entity Recognition: An Evaluation of BERT in the PharmaCoNER task (Sun & Yang, BioNLP 2019)

ACL

• Cong Sun and Zhihao Yang. 2019. Transfer Learning in Biomedical Named Entity Recognition: An Evaluation of BERT in the PharmaCoNER task. In Proceedings of the 5th Workshop on BioNLP Open Shared Tasks, pages 100–104, Hong Kong, China. Association for Computational Linguistics.