MedAI at SemEval-2021 Task 10: Negation-aware Pre-training for Source-free Negation Detection Domain Adaptation

Jinquan Sun, Qi Zhang, Yu Wang, Lei Zhang


Abstract
Due to the increasing concerns for data privacy, source-free unsupervised domain adaptation attracts more and more research attention, where only a trained source model is assumed to be available, while the labeled source data remain private. To get promising adaptation results, we need to find effective ways to transfer knowledge learned in source domain and leverage useful domain specific information from target domain at the same time. This paper describes our winning contribution to SemEval 2021 Task 10: Source-Free Domain Adaptation for Semantic Processing. Our key idea is to leverage the model trained on source domain data to generate pseudo labels for target domain samples. Besides, we propose Negation-aware Pre-training (NAP) to incorporate negation knowledge into model. Our method win the 1st place with F1-score of 0.822 on the official blind test set of Negation Detection Track.
Anthology ID:
2021.semeval-1.183
Volume:
Proceedings of the 15th International Workshop on Semantic Evaluation (SemEval-2021)
Month:
August
Year:
2021
Address:
Online
Editors:
Alexis Palmer, Nathan Schneider, Natalie Schluter, Guy Emerson, Aurelie Herbelot, Xiaodan Zhu
Venue:
SemEval
SIG:
SIGLEX
Publisher:
Association for Computational Linguistics
Note:
Pages:
1283–1288
Language:
URL:
https://aclanthology.org/2021.semeval-1.183
DOI:
10.18653/v1/2021.semeval-1.183
Bibkey:
Cite (ACL):
Jinquan Sun, Qi Zhang, Yu Wang, and Lei Zhang. 2021. MedAI at SemEval-2021 Task 10: Negation-aware Pre-training for Source-free Negation Detection Domain Adaptation. In Proceedings of the 15th International Workshop on Semantic Evaluation (SemEval-2021), pages 1283–1288, Online. Association for Computational Linguistics.
Cite (Informal):
MedAI at SemEval-2021 Task 10: Negation-aware Pre-training for Source-free Negation Detection Domain Adaptation (Sun et al., SemEval 2021)
Copy Citation:
PDF:
https://aclanthology.org/2021.semeval-1.183.pdf