OpenSubtitles2016: Extracting Large Parallel Corpora from Movie and TV Subtitles

Pierre Lison, Jörg Tiedemann


Abstract
We present a new major release of the OpenSubtitles collection of parallel corpora. The release is compiled from a large database of movie and TV subtitles and includes a total of 1689 bitexts spanning 2.6 billion sentences across 60 languages. The release also incorporates a number of enhancements in the preprocessing and alignment of the subtitles, such as the automatic correction of OCR errors and the use of meta-data to estimate the quality of each subtitle and score subtitle pairs.
Anthology ID:
L16-1147
Volume:
Proceedings of the Tenth International Conference on Language Resources and Evaluation (LREC'16)
Month:
May
Year:
2016
Address:
Portorož, Slovenia
Venue:
LREC
SIG:
Publisher:
European Language Resources Association (ELRA)
Note:
Pages:
923–929
Language:
URL:
https://aclanthology.org/L16-1147
DOI:
Bibkey:
Copy Citation:
PDF:
https://aclanthology.org/L16-1147.pdf