Graph Neural Networks for Multiparallel Word Alignment

Ayyoob Imani, Lütfi Kerem Senel, Masoud Jalili Sabet, François Yvon, Hinrich Schuetze


Abstract
After a period of decrease, interest in word alignments is increasing again for their usefulness in domains such as typological research, cross-lingual annotation projection and machine translation. Generally, alignment algorithms only use bitext and do not make use of the fact that many parallel corpora are multiparallel. Here, we compute high-quality word alignments between multiple language pairs by considering all language pairs together. First, we create a multiparallel word alignment graph, joining all bilingual word alignment pairs in one graph. Next, we use graph neural networks (GNNs) to exploit the graph structure. Our GNN approach (i) utilizes information about the meaning, position and language of the input words, (ii) incorporates information from multiple parallel sentences, (iii) adds and removes edges from the initial alignments, and (iv) yields a prediction model that can generalize beyond the training sentences. We show that community detection algorithms can provide valuable information for multiparallel word alignment. Our method outperforms previous work on three word alignment datasets and on a downstream task.
Anthology ID:
2022.findings-acl.108
Volume:
Findings of the Association for Computational Linguistics: ACL 2022
Month:
May
Year:
2022
Address:
Dublin, Ireland
Editors:
Smaranda Muresan, Preslav Nakov, Aline Villavicencio
Venue:
Findings
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
1384–1396
Language:
URL:
https://aclanthology.org/2022.findings-acl.108
DOI:
10.18653/v1/2022.findings-acl.108
Bibkey:
Cite (ACL):
Ayyoob Imani, Lütfi Kerem Senel, Masoud Jalili Sabet, François Yvon, and Hinrich Schuetze. 2022. Graph Neural Networks for Multiparallel Word Alignment. In Findings of the Association for Computational Linguistics: ACL 2022, pages 1384–1396, Dublin, Ireland. Association for Computational Linguistics.
Cite (Informal):
Graph Neural Networks for Multiparallel Word Alignment (Imani et al., Findings 2022)
Copy Citation:
PDF:
https://aclanthology.org/2022.findings-acl.108.pdf
Video:
 https://aclanthology.org/2022.findings-acl.108.mp4