Findings of the WMT26 Terminology Translation Task: The Hard Part is Finding the Terms, Not Using Them

Adrian Charkiewicz, Pinzhen Chen, Thierry Etchegoyhen, Harritxu Gete, Kamil Guttmann, Xu Huang, David Ponce, Artur Nowakowski, Frederic Odermatt, Arturo Oncevay, Dawei Zhu, Vilem Zouhar, Kirill Semenov


Abstract
The WMT26 Terminology Translation Task aims to evaluate machine translation in high-stakes, term-heavy domains (technology, finance, medicine). This year, we focus solely on document-level translation and run two tasks: (1) MT with explicit document-level dictionaries, (2) MT with bitext samples that contain the specific terms. Participants are presented with the texts in three translation directions, two of which feature mid-to-low-resourced morphologically rich languages: Spanish${\rightarrow}$Basque, English${\rightarrow}$Polish, and Traditional Chinese${\rightarrow}$English. This year, the main metrics were multiple variants of overall translation quality and terminology success rate; in line with previous shared tasks, we also compared systems with no terminology, proper dictionaries, and random dictionaries to causally analyze terminology utility. 17 teams participated in our task, submitting 21 systems to Track 1 and 18 systems to Track 2. The results show that document-level translation with explicit dictionaries is close to saturation, and the best systems nearly reach the reference texts. In contrast, for translation with sample bitexts, the spread of the systems is bigger, and the best scores are lower, highlighting the need to concentrate on terminology extraction rather than its use from an explicit source. We also evaluate the grammaticality of the generated texts in Basque and Polish and observe slight trends toward using dictionary forms of the terms and assigning the most frequent grammemes.
Anthology ID:
2026.wmt-main.51
Volume:
Proceedings of the Eleventh Conference on Machine Translation
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Barry Haddow, Tom Kocmi, Philipp Koehn, Christof Monz
Venues:
WMT | WS
SIG:
SIGMT
Publisher:
Association for Computational Linguistics
Note:
Pages:
1046–1079
Language:
URL:
https://aclanthology.org/2026.wmt-main.51/
DOI:
Bibkey:
Cite (ACL):
Adrian Charkiewicz, Pinzhen Chen, Thierry Etchegoyhen, Harritxu Gete, Kamil Guttmann, Xu Huang, David Ponce, Artur Nowakowski, Frederic Odermatt, Arturo Oncevay, Dawei Zhu, Vilem Zouhar, and Kirill Semenov. 2026. Findings of the WMT26 Terminology Translation Task: The Hard Part is Finding the Terms, Not Using Them. In Proceedings of the Eleventh Conference on Machine Translation, pages 1046–1079, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
Findings of the WMT26 Terminology Translation Task: The Hard Part is Finding the Terms, Not Using Them (Charkiewicz et al., WMT 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.wmt-main.51.pdf