Discriminating Similar Languages: Evaluations and Explorations

Cyril Goutte, Serge Léger, Shervin Malmasi, Marcos Zampieri


Abstract
We present an analysis of the performance of machine learning classifiers on discriminating between similar languages and language varieties. We carried out a number of experiments using the results of the two editions of the Discriminating between Similar Languages (DSL) shared task. We investigate the progress made between the two tasks, estimate an upper bound on possible performance using ensemble and oracle combination, and provide learning curves to help us understand which languages are more challenging. A number of difficult sentences are identified and investigated further with human annotation
Anthology ID:
L16-1284
Volume:
Proceedings of the Tenth International Conference on Language Resources and Evaluation (LREC'16)
Month:
May
Year:
2016
Address:
Portorož, Slovenia
Editors:
Nicoletta Calzolari, Khalid Choukri, Thierry Declerck, Sara Goggi, Marko Grobelnik, Bente Maegaard, Joseph Mariani, Helene Mazo, Asuncion Moreno, Jan Odijk, Stelios Piperidis
Venue:
LREC
SIG:
Publisher:
European Language Resources Association (ELRA)
Note:
Pages:
1800–1807
Language:
URL:
https://aclanthology.org/L16-1284
DOI:
Bibkey:
Cite (ACL):
Cyril Goutte, Serge Léger, Shervin Malmasi, and Marcos Zampieri. 2016. Discriminating Similar Languages: Evaluations and Explorations. In Proceedings of the Tenth International Conference on Language Resources and Evaluation (LREC'16), pages 1800–1807, Portorož, Slovenia. European Language Resources Association (ELRA).
Cite (Informal):
Discriminating Similar Languages: Evaluations and Explorations (Goutte et al., LREC 2016)
Copy Citation:
PDF:
https://aclanthology.org/L16-1284.pdf