Is Machine Translation Ready for the Next Crisis or Pandemic?

Vipasha Bansal, William D. Lewis, Nicole Mihaylova, Elizabeth Brown, Benjamin Pong


Abstract
Communication in times of crisis is essential. However, there is often a mismatch between the language of governments, aid providers, doctors, and those to whom they are providing aid. It is reasonable to turn to commercial MT tools in these scenarios. But how effective are these tools for translating to and from low resource languages, particularly in the crisis or medical domain? In this study, we evaluate 5 commercial systems used for MT (Google Translate, Microsoft Translator, GPT, Gemini and Claude) against the TICO-19 dataset, which contains pandemic-related sentences from a large set of high priority languages spoken by communities most likely to be adversely affected in the next pandemic. We assess the current degree of “readiness” for this next pandemic based on the usability of the output translations.
Anthology ID:
2026.lt4cpr-1.8
Volume:
Proceedings of the First Workshop on Language Technologies for Crisis Preparedness and Response
Month:
November
Year:
2026
Address:
Hengqin, China
Editors:
Belu Ticona, Fei Xia, William D. Lewis, Antonios Anastasopoulos
Venues:
LT4CPR | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
78–114
Language:
URL:
https://aclanthology.org/2026.lt4cpr-1.8/
DOI:
Bibkey:
Cite (ACL):
Vipasha Bansal, William D. Lewis, Nicole Mihaylova, Elizabeth Brown, and Benjamin Pong. 2026. Is Machine Translation Ready for the Next Crisis or Pandemic?. In Proceedings of the First Workshop on Language Technologies for Crisis Preparedness and Response, pages 78–114, Hengqin, China. Association for Computational Linguistics.
Cite (Informal):
Is Machine Translation Ready for the Next Crisis or Pandemic? (Bansal et al., LT4CPR 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.lt4cpr-1.8.pdf