MUSE: Modularizing Unsupervised Sense Embeddings

Guang-He Lee, Yun-Nung Chen


Abstract
This paper proposes to address the word sense ambiguity issue in an unsupervised manner, where word sense representations are learned along a word sense selection mechanism given contexts. Prior work focused on designing a single model to deliver both mechanisms, and thus suffered from either coarse-grained representation learning or inefficient sense selection. The proposed modular approach, MUSE, implements flexible modules to optimize distinct mechanisms, achieving the first purely sense-level representation learning system with linear-time sense selection. We leverage reinforcement learning to enable joint training on the proposed modules, and introduce various exploration techniques on sense selection for better robustness. The experiments on benchmark data show that the proposed approach achieves the state-of-the-art performance on synonym selection as well as on contextual word similarities in terms of MaxSimC.
Anthology ID:
D17-1034
Volume:
Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing
Month:
September
Year:
2017
Address:
Copenhagen, Denmark
Editors:
Martha Palmer, Rebecca Hwa, Sebastian Riedel
Venue:
EMNLP
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
327–337
Language:
URL:
https://aclanthology.org/D17-1034
DOI:
10.18653/v1/D17-1034
Bibkey:
Cite (ACL):
Guang-He Lee and Yun-Nung Chen. 2017. MUSE: Modularizing Unsupervised Sense Embeddings. In Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing, pages 327–337, Copenhagen, Denmark. Association for Computational Linguistics.
Cite (Informal):
MUSE: Modularizing Unsupervised Sense Embeddings (Lee & Chen, EMNLP 2017)
Copy Citation:
PDF:
https://aclanthology.org/D17-1034.pdf
Attachment:
 D17-1034.Attachment.zip
Code
 MiuLab/MUSE