TUMHN@WMT2026: LLMs with Limited Resources for Slavic Languages

Tsedeniya Kinfe Temesgen, Sinan Kurtyigit, Alexander Fraser


Abstract
We describe the TUMHN team’s systems for the WMT26 Shared Tasks on LLMs with Lim- ited Resources for Slavic Languages. We partic- ipated in the Ukrainian track, covering machine translation, question answering, spell checking, grammar checking, and math reasoning tasks. We restructured our training dataset into a chat-style format and fine-tuned the Qwen3.5-2B model for the Ukrainian track in a multitask learn- ing setting. Our model outperforms the base- line on three of the five tasks, with significant improvements on Question Answering, Spell Checking, and Grammar Checking. In Machine Translation, the model shows a slight improve- ment for the English–Ukrainian direction. For Spell Checking and Grammar Checking specif- ically, the largest gains were observed in spell or grammatical error detection as opposed to correction. In Math Reasoning, however, our model does not outperform the baseline. The fine-tuned model 1 and training dataset 2 are publicly available on Hugging Face.
Anthology ID:
2026.wmt-main.212
Volume:
Proceedings of the Eleventh Conference on Machine Translation
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Barry Haddow, Tom Kocmi, Philipp Koehn, Christof Monz
Venues:
WMT | WS
SIG:
SIGMT
Publisher:
Association for Computational Linguistics
Note:
Pages:
2682–2688
Language:
URL:
https://aclanthology.org/2026.wmt-main.212/
DOI:
Bibkey:
Cite (ACL):
Tsedeniya Kinfe Temesgen, Sinan Kurtyigit, and Alexander Fraser. 2026. TUMHN@WMT2026: LLMs with Limited Resources for Slavic Languages. In Proceedings of the Eleventh Conference on Machine Translation, pages 2682–2688, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
TUMHN@WMT2026: LLMs with Limited Resources for Slavic Languages (Temesgen et al., WMT 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.wmt-main.212.pdf