HiTRANS: A Hierarchical Transformer Network for Nested Named Entity Recognition

Zhiwei Yang, Jing Ma, Hechang Chen, Yunke Zhang, Yi Chang


Abstract
Nested Named Entity Recognition (NNER) has been extensively studied, aiming to identify all nested entities from potential spans (i.e., one or more continuous tokens). However, recent studies for NNER either focus on tedious tagging schemas or utilize complex structures, which fail to learn effective span representations from the input sentence with highly nested entities. Intuitively, explicit span representations will contribute to NNER due to the rich context information they contain. In this study, we propose a Hierarchical Transformer (HiTRANS) network for the NNER task, which decomposes the input sentence into multi-grained spans and enhances the representation learning in a hierarchical manner. Specifically, we first utilize a two-phase module to generate span representations by aggregating context information based on a bottom-up and top-down transformer network. Then a label prediction layer is designed to recognize nested entities hierarchically, which naturally explores semantic dependencies among different spans. Experiments on GENIA, ACE-2004, ACE-2005 and NNE datasets demonstrate that our proposed method achieves much better performance than the state-of-the-art approaches.
Anthology ID:
2021.findings-emnlp.12
Volume:
Findings of the Association for Computational Linguistics: EMNLP 2021
Month:
November
Year:
2021
Address:
Punta Cana, Dominican Republic
Editors:
Marie-Francine Moens, Xuanjing Huang, Lucia Specia, Scott Wen-tau Yih
Venue:
Findings
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
124–132
Language:
URL:
https://aclanthology.org/2021.findings-emnlp.12
DOI:
10.18653/v1/2021.findings-emnlp.12
Bibkey:
Cite (ACL):
Zhiwei Yang, Jing Ma, Hechang Chen, Yunke Zhang, and Yi Chang. 2021. HiTRANS: A Hierarchical Transformer Network for Nested Named Entity Recognition. In Findings of the Association for Computational Linguistics: EMNLP 2021, pages 124–132, Punta Cana, Dominican Republic. Association for Computational Linguistics.
Cite (Informal):
HiTRANS: A Hierarchical Transformer Network for Nested Named Entity Recognition (Yang et al., Findings 2021)
Copy Citation:
PDF:
https://aclanthology.org/2021.findings-emnlp.12.pdf
Data
GENIANNE