Enhancing the Context Representation in Similarity-based Word Sense Disambiguation

Ming Wang, Jianzhang Zhang, Yinglin Wang


Abstract
In previous similarity-based WSD systems, studies have allocated much effort on learning comprehensive sense embeddings using contextual representations and knowledge sources. However, the context embedding of an ambiguous word is learned using only the sentence where the word appears, neglecting its global context. In this paper, we investigate the contribution of both word-level and sense-level global context of an ambiguous word for disambiguation. Experiments have shown that the Context-Oriented Embedding (COE) can enhance a similarity-based system’s performance on WSD by relatively large margins, achieving state-of-the-art on all-words WSD benchmarks in knowledge-based category.
Anthology ID:
2021.emnlp-main.706
Volume:
Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing
Month:
November
Year:
2021
Address:
Online and Punta Cana, Dominican Republic
Editors:
Marie-Francine Moens, Xuanjing Huang, Lucia Specia, Scott Wen-tau Yih
Venue:
EMNLP
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
8965–8973
Language:
URL:
https://aclanthology.org/2021.emnlp-main.706
DOI:
10.18653/v1/2021.emnlp-main.706
Bibkey:
Cite (ACL):
Ming Wang, Jianzhang Zhang, and Yinglin Wang. 2021. Enhancing the Context Representation in Similarity-based Word Sense Disambiguation. In Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing, pages 8965–8973, Online and Punta Cana, Dominican Republic. Association for Computational Linguistics.
Cite (Informal):
Enhancing the Context Representation in Similarity-based Word Sense Disambiguation (Wang et al., EMNLP 2021)
Copy Citation:
PDF:
https://aclanthology.org/2021.emnlp-main.706.pdf
Software:
 2021.emnlp-main.706.Software.zip
Video:
 https://aclanthology.org/2021.emnlp-main.706.mp4
Data
Word Sense Disambiguation: a Unified Evaluation Framework and Empirical Comparison