Label-Enhanced Hierarchical Contextualized Representation for Sequential Metaphor Identification

Shuqun Li, Liang Yang, Weidong He, Shiqi Zhang, Jingjie Zeng, Hongfei Lin


Abstract
Recent metaphor identification approaches mainly consider the contextual text features within a sentence or introduce external linguistic features to the model. But they usually ignore the extra information that the data can provide, such as the contextual metaphor information and broader discourse information. In this paper, we propose a model augmented with hierarchical contextualized representation to extract more information from both sentence-level and discourse-level. At the sentence level, we leverage the metaphor information of words that except the target word in the sentence to strengthen the reasoning ability of our model via a novel label-enhanced contextualized representation. At the discourse level, the position-aware global memory network is adopted to learn long-range dependency among the same words within a discourse. Finally, our model combines the representations obtained from these two parts. The experiment results on two tasks of the VUA dataset show that our model outperforms every other state-of-the-art method that also does not use any external knowledge except what the pre-trained language model contains.
Anthology ID:
2021.emnlp-main.286
Volume:
Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing
Month:
November
Year:
2021
Address:
Online and Punta Cana, Dominican Republic
Editors:
Marie-Francine Moens, Xuanjing Huang, Lucia Specia, Scott Wen-tau Yih
Venue:
EMNLP
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
3533–3543
Language:
URL:
https://aclanthology.org/2021.emnlp-main.286
DOI:
10.18653/v1/2021.emnlp-main.286
Bibkey:
Cite (ACL):
Shuqun Li, Liang Yang, Weidong He, Shiqi Zhang, Jingjie Zeng, and Hongfei Lin. 2021. Label-Enhanced Hierarchical Contextualized Representation for Sequential Metaphor Identification. In Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing, pages 3533–3543, Online and Punta Cana, Dominican Republic. Association for Computational Linguistics.
Cite (Informal):
Label-Enhanced Hierarchical Contextualized Representation for Sequential Metaphor Identification (Li et al., EMNLP 2021)
Copy Citation:
PDF:
https://aclanthology.org/2021.emnlp-main.286.pdf
Video:
 https://aclanthology.org/2021.emnlp-main.286.mp4