Word Sense Disambiguation: Towards Interactive Context Exploitation from Both Word and Sense Perspectives

Ming Wang, Yinglin Wang


Abstract
Lately proposed Word Sense Disambiguation (WSD) systems have approached the estimated upper bound of the task on standard evaluation benchmarks. However, these systems typically implement the disambiguation of words in a document almost independently, underutilizing sense and word dependency in context. In this paper, we convert the nearly isolated decisions into interrelated ones by exposing senses in context when learning sense embeddings in a similarity-based Sense Aware Context Exploitation (SACE) architecture. Meanwhile, we enhance the context embedding learning with selected sentences from the same document, rather than utilizing only the sentence where each ambiguous word appears. Experiments on both English and multilingual WSD datasets have shown the effectiveness of our approach, surpassing previous state-of-the-art by large margins (3.7% and 1.2% respectively), especially on few-shot (14.3%) and zero-shot (35.9%) scenarios.
Anthology ID:
2021.acl-long.406
Volume:
Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers)
Month:
August
Year:
2021
Address:
Online
Editors:
Chengqing Zong, Fei Xia, Wenjie Li, Roberto Navigli
Venues:
ACL | IJCNLP
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
5218–5229
Language:
URL:
https://aclanthology.org/2021.acl-long.406
DOI:
10.18653/v1/2021.acl-long.406
Bibkey:
Cite (ACL):
Ming Wang and Yinglin Wang. 2021. Word Sense Disambiguation: Towards Interactive Context Exploitation from Both Word and Sense Perspectives. In Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers), pages 5218–5229, Online. Association for Computational Linguistics.
Cite (Informal):
Word Sense Disambiguation: Towards Interactive Context Exploitation from Both Word and Sense Perspectives (Wang & Wang, ACL-IJCNLP 2021)
Copy Citation:
PDF:
https://aclanthology.org/2021.acl-long.406.pdf
Video:
 https://aclanthology.org/2021.acl-long.406.mp4
Code
 lwmlyy/sace
Data
Word Sense Disambiguation: a Unified Evaluation Framework and Empirical Comparison