Lakmali Piyarathna
2021
Metric Learning in Multilingual Sentence Similarity Measurement for Document Alignment
Charith Rajitha
|
Lakmali Piyarathna
|
Dilan Sachintha
|
Surangika Ranathunga
Proceedings of the International Conference on Recent Advances in Natural Language Processing (RANLP 2021)
Document alignment techniques based on multilingual sentence representations have recently shown state of the art results. However, these techniques rely on unsupervised distance measurement techniques, which cannot be fined-tuned to the task at hand. In this paper, instead of these unsupervised distance measurement techniques, we employ Metric Learning to derive task-specific distance measurements. These measurements are supervised, meaning that the distance measurement metric is trained using a parallel dataset. Using a dataset belonging to English, Sinhala, and Tamil, which belong to three different language families, we show that these task-specific supervised distance learning metrics outperform their unsupervised counterparts, for document alignment.
Search