The Croatian Dataset Seed Submission to the WMT26 Open Language Data Initiative Shared Task

Dragana Zundanović, Hrvoje Leventić, Dragana Božić Lenard, Krešimir Romić


Abstract
We present a new English–Croatian parallel corpus for the WMT26 Open Language Data Initiative (OLDI) Seed shared task, consisting of 6,193 sentence pairs. To ensure high quality, the resource was produced via machine translation followed by a two-stage verification process (post-editing and independent revision) conducted by professional translators. We validate the corpus by fine-tuning NLLB-200, TranslateGemma, and Gemma-4-31B. The dataset improves every dedicated translation model in both directions and the strongest open LLMs in the Croatian→English direction. Through a training-data ablation, we demonstrate that the benefit of human verification increases with model capacity and is visible only to neural metrics, not to surfaceoverlap metrics such as chrF++. Finally, we analyze the quality ceiling for the strongest models, identifying a trade-off between naturalness and surface overlap in the English→Croatian direction.
Anthology ID:
2026.wmt-main.201
Volume:
Proceedings of the Eleventh Conference on Machine Translation
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Barry Haddow, Tom Kocmi, Philipp Koehn, Christof Monz
Venues:
WMT | WS
SIG:
SIGMT
Publisher:
Association for Computational Linguistics
Note:
Pages:
2571–2583
Language:
URL:
https://aclanthology.org/2026.wmt-main.201/
DOI:
Bibkey:
Cite (ACL):
Dragana Zundanović, Hrvoje Leventić, Dragana Božić Lenard, and Krešimir Romić. 2026. The Croatian Dataset Seed Submission to the WMT26 Open Language Data Initiative Shared Task. In Proceedings of the Eleventh Conference on Machine Translation, pages 2571–2583, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
The Croatian Dataset Seed Submission to the WMT26 Open Language Data Initiative Shared Task (Zundanović et al., WMT 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.wmt-main.201.pdf