Integrating Personalized PageRank into Neural Word Sense Disambiguation

Ahmed El Sheikh, Michele Bevilacqua, Roberto Navigli


Abstract
Neural Word Sense Disambiguation (WSD) has recently been shown to benefit from the incorporation of pre-existing knowledge, such as that coming from the WordNet graph. However, state-of-the-art approaches have been successful in exploiting only the local structure of the graph, with only close neighbors of a given synset influencing the prediction. In this work, we improve a classification model by recomputing logits as a function of both the vanilla independently produced logits and the global WordNet graph. We achieve this by incorporating an online neural approximated PageRank, which enables us to refine edge weights as well. This method exploits the global graph structure while keeping space requirements linear in the number of edges. We obtain strong improvements, matching the current state of the art. Code is available at https://github.com/SapienzaNLP/neural-pagerank-wsd
Anthology ID:
2021.emnlp-main.715
Volume:
Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing
Month:
November
Year:
2021
Address:
Online and Punta Cana, Dominican Republic
Editors:
Marie-Francine Moens, Xuanjing Huang, Lucia Specia, Scott Wen-tau Yih
Venue:
EMNLP
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
9092–9098
Language:
URL:
https://aclanthology.org/2021.emnlp-main.715
DOI:
10.18653/v1/2021.emnlp-main.715
Bibkey:
Cite (ACL):
Ahmed El Sheikh, Michele Bevilacqua, and Roberto Navigli. 2021. Integrating Personalized PageRank into Neural Word Sense Disambiguation. In Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing, pages 9092–9098, Online and Punta Cana, Dominican Republic. Association for Computational Linguistics.
Cite (Informal):
Integrating Personalized PageRank into Neural Word Sense Disambiguation (El Sheikh et al., EMNLP 2021)
Copy Citation:
PDF:
https://aclanthology.org/2021.emnlp-main.715.pdf
Video:
 https://aclanthology.org/2021.emnlp-main.715.mp4
Code
 sapienzanlp/neural-pagerank-wsd
Data
Word Sense Disambiguation: a Unified Evaluation Framework and Empirical Comparison