Effectively Aligning and Filtering Parallel Corpora under Sparse Data Conditions

Steinþór Steingrímsson, Hrafn Loftsson, Andy Way


Abstract
Parallel corpora are key to developing good machine translation systems. However, abundant parallel data are hard to come by, especially for languages with a low number of speakers. When rich morphology exacerbates the data sparsity problem, it is imperative to have accurate alignment and filtering methods that can help make the most of what is available by maximising the number of correctly translated segments in a corpus and minimising noise by removing incorrect translations and segments containing extraneous data. This paper sets out a research plan for improving alignment and filtering methods for parallel texts in low-resource settings. We propose an effective unsupervised alignment method to tackle the alignment problem. Moreover, we propose a strategy to supplement state-of-the-art models with automatically extracted information using basic NLP tools to effectively handle rich morphology.
Anthology ID:
2020.acl-srw.25
Volume:
Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics: Student Research Workshop
Month:
July
Year:
2020
Address:
Online
Editors:
Shruti Rijhwani, Jiangming Liu, Yizhong Wang, Rotem Dror
Venue:
ACL
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
182–190
Language:
URL:
https://aclanthology.org/2020.acl-srw.25
DOI:
10.18653/v1/2020.acl-srw.25
Bibkey:
Cite (ACL):
Steinþór Steingrímsson, Hrafn Loftsson, and Andy Way. 2020. Effectively Aligning and Filtering Parallel Corpora under Sparse Data Conditions. In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics: Student Research Workshop, pages 182–190, Online. Association for Computational Linguistics.
Cite (Informal):
Effectively Aligning and Filtering Parallel Corpora under Sparse Data Conditions (Steingrímsson et al., ACL 2020)
Copy Citation:
PDF:
https://aclanthology.org/2020.acl-srw.25.pdf
Video:
 http://slideslive.com/38928666