@inproceedings{specia-etal-2020-findings,
    title = "Findings of the {WMT} 2020 Shared Task on Machine Translation Robustness",
    author = "Specia, Lucia  and
      Li, Zhenhao  and
      Pino, Juan  and
      Chaudhary, Vishrav  and
      Guzm{\'a}n, Francisco  and
      Neubig, Graham  and
      Durrani, Nadir  and
      Belinkov, Yonatan  and
      Koehn, Philipp  and
      Sajjad, Hassan  and
      Michel, Paul  and
      Li, Xian",
    booktitle = "Proceedings of the Fifth Conference on Machine Translation",
    month = nov,
    year = "2020",
    address = "Online",
    publisher = "Association for Computational Linguistics",
    url = "https://aclanthology.org/2020.wmt-1.4",
    pages = "76--91",
    abstract = "We report the findings of the second edition of the shared task on improving robustness in Machine Translation (MT). The task aims to test current machine translation systems in their ability to handle challenges facing MT models to be deployed in the real world, including domain diversity and non-standard texts common in user generated content, especially in social media. We cover two language pairs {--} English-German and English-Japanese and provide test sets in zero-shot and few-shot variants. Participating systems are evaluated both automatically and manually, with an additional human evaluation for {''}catastrophic errors{''}. We received 59 submissions by 11 participating teams from a variety of types of institutions.",
}