Metric Learning in Multilingual Sentence Similarity Measurement for Document Alignment

Charith Rajitha, Lakmali Piyarathna, Dilan Sachintha, Surangika Ranathunga


Abstract
Document alignment techniques based on multilingual sentence representations have recently shown state of the art results. However, these techniques rely on unsupervised distance measurement techniques, which cannot be fined-tuned to the task at hand. In this paper, instead of these unsupervised distance measurement techniques, we employ Metric Learning to derive task-specific distance measurements. These measurements are supervised, meaning that the distance measurement metric is trained using a parallel dataset. Using a dataset belonging to English, Sinhala, and Tamil, which belong to three different language families, we show that these task-specific supervised distance learning metrics outperform their unsupervised counterparts, for document alignment.
Anthology ID:
2021.ranlp-1.129
Volume:
Proceedings of the International Conference on Recent Advances in Natural Language Processing (RANLP 2021)
Month:
September
Year:
2021
Address:
Held Online
Editors:
Ruslan Mitkov, Galia Angelova
Venue:
RANLP
SIG:
Publisher:
INCOMA Ltd.
Note:
Pages:
1150–1157
Language:
URL:
https://aclanthology.org/2021.ranlp-1.129
DOI:
Bibkey:
Cite (ACL):
Charith Rajitha, Lakmali Piyarathna, Dilan Sachintha, and Surangika Ranathunga. 2021. Metric Learning in Multilingual Sentence Similarity Measurement for Document Alignment. In Proceedings of the International Conference on Recent Advances in Natural Language Processing (RANLP 2021), pages 1150–1157, Held Online. INCOMA Ltd..
Cite (Informal):
Metric Learning in Multilingual Sentence Similarity Measurement for Document Alignment (Rajitha et al., RANLP 2021)
Copy Citation:
PDF:
https://aclanthology.org/2021.ranlp-1.129.pdf