Antoni Oliver González
Also published as: Antoni Oliver Gonzalez
2023
Filtering and rescoring the CCMatrix corpus for Neural Machine Translation training
Antoni Oliver González
|
Sergi Álvarez
Proceedings of the 24th Annual Conference of the European Association for Machine Translation
There are several parallel corpora available for many language pairs, such as CCMatrix, built from mass downloads of web content and automatic detection of segments in one language and the translation equivalent in another. These techniques can produce large parallel corpora, but of questionable quality. In many cases, the segments are not in the required languages, or if they are, they are not translation equivalents. In this article, we present an algorithm for filtering out the segments in languages other than the required ones and re-scoring the segments using SBERT. A use case on the Spanish-Asturian and Spanish-Catalan CCMatrix corpus is presented.
2006
Automatic Multilingual Subtitling in the eTitle Project
Antoni Oliver Gonzalez
Proceedings of Translating and the Computer 28
Search