OpenSubtitles2016: Extracting Large Parallel Corpora from Movie and TV Subtitles

Pierre Lison, Jörg Tiedemann


Abstract
We present a new major release of the OpenSubtitles collection of parallel corpora. The release is compiled from a large database of movie and TV subtitles and includes a total of 1689 bitexts spanning 2.6 billion sentences across 60 languages. The release also incorporates a number of enhancements in the preprocessing and alignment of the subtitles, such as the automatic correction of OCR errors and the use of meta-data to estimate the quality of each subtitle and score subtitle pairs.
Anthology ID:
L16-1147
Volume:
Proceedings of the Tenth International Conference on Language Resources and Evaluation (LREC'16)
Month:
May
Year:
2016
Address:
Portorož, Slovenia
Editors:
Nicoletta Calzolari, Khalid Choukri, Thierry Declerck, Sara Goggi, Marko Grobelnik, Bente Maegaard, Joseph Mariani, Helene Mazo, Asuncion Moreno, Jan Odijk, Stelios Piperidis
Venue:
LREC
SIG:
Publisher:
European Language Resources Association (ELRA)
Note:
Pages:
923–929
Language:
URL:
https://aclanthology.org/L16-1147
DOI:
Bibkey:
Cite (ACL):
Pierre Lison and Jörg Tiedemann. 2016. OpenSubtitles2016: Extracting Large Parallel Corpora from Movie and TV Subtitles. In Proceedings of the Tenth International Conference on Language Resources and Evaluation (LREC'16), pages 923–929, Portorož, Slovenia. European Language Resources Association (ELRA).
Cite (Informal):
OpenSubtitles2016: Extracting Large Parallel Corpora from Movie and TV Subtitles (Lison & Tiedemann, LREC 2016)
Copy Citation:
PDF:
https://aclanthology.org/L16-1147.pdf
Data
OpenSubtitles